00000001:02000400:0.0F:1789351095.959766:0:2960:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1789351105.014007:0:3163:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789351106.063426:0:3224:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1411 MB/s 00000001:01000000:3.0:1789351106.313386:0:3224:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1731 MB/s 00000001:01000000:3.0:1789351106.563397:0:3224:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10739 MB/s 00000020:02000000:3.0:1789351106.829381:0:3255:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.56_50_ge20528f 00000400:02000000:2.0:1789351107.139256:0:3270:0:(api-ni.c:2822:lnet_startup_lndni()) Added LNI 192.168.201.152@tcp [8/256/0/180] 00008000:02000000:2.0:1789351109.775425:0:3419:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789351135.646197:0:5225:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789351141.292473:0:5803:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789351141.292478:0:5803:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789351141.292635:0:5803:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000c9ac87bb 00000080:02000400:2.0:1789351141.292646:0:5803:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789351141.296711:0:5803:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789351141.296727:0:5803:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789351141.296769:0:5803:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000da00692) 00000020:00000080:2.0:1789351141.296792:0:5803:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0F:1789351141.317899:0:5803:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789351141.318938:0:5803:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789351141.344975:0:5803:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789351141.345046:0:5803:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789351141.345066:0:5803:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789351141.345114:0:5803:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789351141.345136:0:5803:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789351141.345754:0:5803:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789351141.345763:0:5803:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789351141.345774:0:5803:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6ea017771df68e2 00000020:01000004:2.0:1789351141.345781:0:5803:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789351141.345786:0:5803:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789351141.345790:0:5803:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c9ac87bb from MGS 00000020:01000004:2.0:1789351141.345793:0:5803:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789351141.345803:0:5803:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000001723b28b) 00000020:00000080:2.0:1789351141.345813:0:5803:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789351141.345889:0:5803:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c9ac87bb from MGS, refs=2 00080000:01000000:2.0:1789351141.345895:0:5803:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789351141.345900:0:5803:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6ea017771df68f0 00000100:00100000:2.0:1789351141.346307:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789351141.346749:0:5803:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789351141.346756:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789351141.347599:0:5803:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789351141.347607:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789351141.351774:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789351141.351944:0:5803:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789351141.351950:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789351141.353043:0:5803:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789351141.353051:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789351141.353764:0:5803:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789351141.353771:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789351141.354842:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351141.354846:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351141.354848:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351141.355944:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351141.355948:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351141.355949:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351141.356536:0:5803:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789351141.358471:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789351141.610118:0:5803:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4822 MB/s 00000001:01000000:2.0:1789351141.859487:0:5803:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4523 MB/s 00000001:01000000:3.0:1789351142.109436:0:5803:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1107 MB/s 00000001:01000000:0.0:1789351142.359874:0:5803:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1255 MB/s 00080000:10000000:0.0:1789351142.363634:0:5803:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1789351142.370054:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789351142.371077:0:5803:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789351142.371088:0:5803:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789351142.371090:0:5803:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789351142.371683:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789351142.372548:0:5803:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789351142.372578:0:5803:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789351142.372697:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789351142.372722:0:5803:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789351142.373131:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789351142.373255:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789351142.373261:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789351142.373869:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789351142.373876:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789351142.374247:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789351142.374253:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789351142.374951:0:5803:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789351142.374981:0:5803:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.152@tcp' 00000020:01000004:3.0:1789351142.374983:0:5803:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789351142.375032:0:5803:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.152@tcp (typ=mgc) 00000020:00000080:3.0:1789351142.375050:0:5803:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.152@tcp (00000000b66e3aed) 00000020:00000080:3.0:1789351142.375066:0:5803:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789351142.375177:0:5803:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d0019856@MGC192.168.201.152@tcp: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1789351142.375304:0:5803:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.152@tcp-0 is initialized 00000040:01000000:3.0:1789351142.375309:0:5803:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789351142.378086:0:5818:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789351142.380279:0:5820:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789351142.380348:0:5803:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.152@tcp (uuid f7166352-9951-4386-a0b0-6dc1f552d00a) 00000020:00000080:2.0:1789351142.380408:0:5803:0:(genops.c:1406:class_connect()) connect: client f7166352-9951-4386-a0b0-6dc1f552d00a, cookie 0xa6ea017771df68fe 00000100:00080000:2.0:1789351142.380420:0:5803:0:(import.c:510:import_select_connection()) MGC192.168.201.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789351142.380425:0:5803:0:(import.c:624:import_select_connection()) MGC192.168.201.152@tcp: import 00000000d0019856 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789351142.380468:0:5803:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000edd83b7e x1876270626373760/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789351142.380493:0:5803:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f7166352-9951-4386-a0b0-6dc1f552d00a->MGS 00000020:01000004:2.0:1789351142.380515:0:5803:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789351142.380520:0:5803:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789351142.380533:0:5803:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000bff8e7b7) 00000020:00000080:2.0:1789351142.380545:0:5803:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789351142.380606:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000edd83b7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f7166352-9951-4386-a0b0-6dc1f552d00a:3285:1876270626373760:0@lo:250: 00000100:00100000:0.0:1789351142.380673:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351142.380741:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626373760 00000100:00100000:0.0:1789351142.380749:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626373760 00000100:00100000:0.0:1789351142.380791:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351142.380797:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc85db5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3285:x1876270626373760:12345-0@lo:250: 00010000:00080000:0.0:1789351142.380817:0:5814:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from f7166352-9951-4386-a0b0-6dc1f552d00a@0@lo t0 exp 0000000000000000 cur 86 last 0 00000020:00000080:0.0:1789351142.380848:0:5814:0:(genops.c:1406:class_connect()) connect: client f7166352-9951-4386-a0b0-6dc1f552d00a, cookie 0xa6ea017771df690c 00000100:00080000:0.0:1789351142.380989:0:5814:0:(import.c:65:import_set_state_nolock()) 00000000457e9a58 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789351142.381046:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc85db5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+5:3285:x1876270626373760:12345-0@lo:250: Request processed in 247us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351142.381054:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351142.381093:0:3285:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789351142.381101:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.152@tcp: connect to target with instance 0 00000100:00080000:0.0:1789351142.381108:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789351142.381119:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789351142.381122:0:3285:0:(import.c:65:import_set_state_nolock()) 00000000d0019856 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789351142.381124:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789351142.381131:0:3285:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789351142.381134:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000edd83b7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f7166352-9951-4386-a0b0-6dc1f552d00a:3285:1876270626373760:0@lo:250: 00000100:00100000:2.0:1789351142.389108:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789351142.389271:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789351142.389277:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789351142.390030:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789351142.390035:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789351142.390232:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789351142.390236:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789351142.390848:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789351142.390952:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789351142.390959:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789351142.391479:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789351142.391486:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789351142.412593:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789351142.412745:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789351142.412751:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789351142.413614:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789351142.413620:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789351142.414083:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789351142.414185:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789351142.414188:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789351142.414582:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789351142.414587:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789351142.414950:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789351142.415063:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789351142.415068:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789351142.415336:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789351142.415340:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789351142.415701:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789351142.415788:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789351142.415795:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789351142.416081:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789351142.416087:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789351142.439856:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789351142.440035:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789351142.440041:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789351142.441397:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789351142.441408:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789351142.441937:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789351142.441944:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789351142.443069:0:5803:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789351142.443093:0:5803:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789351142.443099:0:5803:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789351142.443214:0:5803:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789351142.443240:0:5803:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.152@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789351142.443244:0:5803:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789351142.443245:0:5803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789351142.443246:0:5803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789351142.443247:0:5803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789351142.443247:0:5803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789351142.443248:0:5803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789351142.443249:0:5803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789351142.443250:0:5803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789351142.443250:0:5803:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789351142.443251:0:5803:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789351142.443252:0:5803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789351142.443253:0:5803:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789351142.443254:0:5803:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789351142.443256:0:5803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789351142.443256:0:5803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789351142.443257:0:5803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789351142.443257:0:5803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789351142.443258:0:5803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789351142.443261:0:5803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789351142.443261:0:5803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789351142.443262:0:5803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789351142.443263:0:5803:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789351142.443263:0:5803:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789351142.443264:0:5803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789351142.443265:0:5803:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789351142.443303:0:5803:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789351142.443320:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005933aaad pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626373888:0@lo:253: 00000100:00100000:0.0:1789351142.443434:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351142.443527:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 0000000031936aa1 going to sleep for 11 seconds 00000100:00100000:2.0:1789351142.443577:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626373888 00000100:00100000:2.0:1789351142.443585:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626373888 00000100:00100000:2.0:1789351142.443650:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789351142.443656:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ffc6e1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+5:5803:x1876270626373888:12345-0@lo:253: 20000000:01000000:2.0:1789351142.443687:0:5817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789351142.443688:0:5817:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789351142.443953:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789351142.443991:0:5817:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1789351142.444230:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789351142.445139:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789351142.445309:0:5817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789351142.445312:0:5817:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789351142.445317:0:5817:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789351142.445320:0:5817:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789351142.445330:0:5817:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789351142.445647:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789351142.445854:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789351142.445864:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789351142.445903:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789351142.445942:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789351142.445986:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789351142.446060:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789351142.446067:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789351142.446102:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789351142.446109:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789351142.446132:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789351142.446138:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789351142.446173:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789351142.446211:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789351142.446235:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789351142.446239:0:5817:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789351142.446249:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789351142.446540:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789351142.446549:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789351142.446577:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789351142.446603:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789351142.446640:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789351142.446649:0:5817:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789351142.446706:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789351142.446713:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789351142.446746:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789351142.446774:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789351142.446817:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789351142.446827:0:5817:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789351142.446898:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789351142.446905:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789351142.446944:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789351142.447008:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789351142.447156:0:5817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789351142.447202:0:5817:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789351142.447209:0:5817:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789351142.447779:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789351142.448354:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789351142.448540:0:5817:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.152@tcp for mdt 20000000:01000000:2.0:1789351142.448543:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:2.0:1789351142.448583:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789351142.448591:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789351142.448622:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789351142.448630:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:2.0:1789351142.448677:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789351142.448698:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789351142.448736:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789351142.448848:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789351142.449004:0:5817:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789351142.449008:0:5817:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789351142.449012:0:5817:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789351142.449037:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789351142.449040:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789351142.449070:0:5817:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789351142.449072:0:5817:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789351142.449646:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789351142.450045:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789351142.450079:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789351142.450108:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1789351142.450118:0:5817:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789351142.450120:0:5817:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789351142.450718:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1789351142.451063:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789351142.451101:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1789351142.451158:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1789351142.451172:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789351142.451175:0:5817:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1789351142.451179:0:5817:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789351142.451182:0:5817:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789351142.451186:0:5817:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789351142.451191:0:5817:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789351142.451740:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1789351142.451978:0:5817:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789351142.458936:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789351142.459002:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789351142.459075:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789351142.459096:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789351142.459115:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004a582372/0xa6ea017771df6913 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.459135:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a582372/0xa6ea017771df6913 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.459144:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a582372/0xa6ea017771df6913 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.459150:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a582372/0xa6ea017771df6913 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.459156:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004a582372/0xa6ea017771df6913 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.459162:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004a582372/0xa6ea017771df6913 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.459168:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a582372 already unused, calling callback (000000004b1ccba6) 00010000:00010000:2.0:1789351142.459171:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004a582372/0xa6ea017771df6913 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.459178:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004a582372/0xa6ea017771df6913 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.459188:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004a582372/0xa6ea017771df6913 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.459194:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004a582372/0xa6ea017771df6913 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.459199:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004a582372/0xa6ea017771df6913 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789351142.459222:0:5817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789351142.582915:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ffc6e1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+5:5803:x1876270626373888:12345-0@lo:253: Request processed in 139252us (139474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351142.582931:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789351142.582937:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005933aaad pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626373888:0@lo:253: 10000000:01000000:2.0:1789351142.582951:0:5803:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789351142.582954:0:5803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789351142.582956:0:5803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789351142.582957:0:5803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789351142.582958:0:5803:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789351142.582959:0:5803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789351142.582960:0:5803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789351142.582961:0:5803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789351142.582962:0:5803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789351142.582963:0:5803:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789351142.582976:0:5803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789351142.582977:0:5803:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789351142.582994:0:5803:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c9ac87bb from lustre-MDT0000 10000000:01000000:2.0:1789351142.583018:0:5803:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789351142.583020:0:5803:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789351142.583023:0:5803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d2cd83919c0 10000000:01000000:2.0:1789351142.583027:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789351142.583032:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2cd83919c0 from 1 10000000:01000000:2.0:1789351142.583034:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789351142.583064:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df691a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.583071:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df691a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.583077:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df691a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351142.583091:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008673338c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626374016:0@lo:101: 00000100:00100000:2.0:1789351142.583144:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351142.583183:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626374016 00000100:00100000:2.0:1789351142.583189:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bca58c0a going to sleep for 11 seconds 00000100:00100000:0.0:1789351142.583189:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626374016 00000100:00100000:0.0:1789351142.583219:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789351142.583226:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082923ccc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+5:5803:x1876270626374016:12345-0@lo:101: 00010000:00010000:0.0:1789351142.583248:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351142.583262:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091c7de22/0xa6ea017771df6921 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df691a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351142.583403:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091c7de22/0xa6ea017771df6921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df691a expref: 6 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351142.583413:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091c7de22/0xa6ea017771df6921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df691a expref: 6 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351142.583422:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091c7de22, rc 0) 00000100:00100000:1.0:1789351142.583513:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082923ccc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+6:5803:x1876270626374016:12345-0@lo:101: Request processed in 288us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351142.583518:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789351142.583559:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008673338c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626374016:0@lo:101: 00010000:00010000:2.0:1789351142.583569:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df691a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6921 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.583574:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df691a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6921 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351142.583604:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008673338c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626374144:0@lo:501: 00000100:00100000:2.0:1789351142.583620:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351142.583638:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bca58c0a going to sleep for 11 seconds 00000100:00100000:0.0:1789351142.583655:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626374144 00000100:00100000:0.0:1789351142.583659:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626374144 00000100:00100000:0.0:1789351142.583681:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789351142.583686:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006b7fda9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+6:5803:x1876270626374144:12345-0@lo:501: 00000100:00100000:0.0:1789351142.583854:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006b7fda9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+6:5803:x1876270626374144:12345-0@lo:501: Request processed in 168us (233us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789351142.583861:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789351142.583870:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008673338c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626374144:0@lo:501: 10000000:01000000:2.0:1789351142.583890:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789351142.583900:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df691a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6921 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.583908:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df691a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6921 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351142.583914:0:5803:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2cc5fed000 10000000:01000000:2.0:1789351142.583917:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789351142.583920:0:5803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d2cc5fed000 10000000:01000000:2.0:1789351142.583923:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789351142.583925:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8d2cc5fed000 from 1 10000000:01000000:2.0:1789351142.583927:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789351142.583939:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 000000006f46cee9/0xa6ea017771df6928 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.583954:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 000000006f46cee9/0xa6ea017771df6928 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.583961:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 000000006f46cee9/0xa6ea017771df6928 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351142.583984:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008673338c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626374272:0@lo:101: 00000100:00100000:2.0:1789351142.584007:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351142.584051:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bca58c0a going to sleep for 11 seconds 00000100:00100000:1.0:1789351142.584080:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626374272 00000100:00100000:1.0:1789351142.584083:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626374272 00000100:00100000:1.0:1789351142.584136:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789351142.584141:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063927a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+6:5803:x1876270626374272:12345-0@lo:101: 00010000:00010000:1.0:1789351142.584145:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351142.584152:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000066b0e030/0xa6ea017771df692f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6928 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351142.584161:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000066b0e030/0xa6ea017771df692f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6928 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351142.584165:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000066b0e030/0xa6ea017771df692f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6928 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351142.584170:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000066b0e030, rc 0) 00000100:00100000:1.0:1789351142.584195:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063927a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+7:5803:x1876270626374272:12345-0@lo:101: Request processed in 54us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351142.584200:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789351142.584226:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008673338c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626374272:0@lo:101: 00010000:00010000:0.0:1789351142.584235:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 000000006f46cee9/0xa6ea017771df6928 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df692f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351142.584252:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 000000006f46cee9/0xa6ea017771df6928 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df692f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351142.584263:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789351142.584390:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 000000006f46cee9/0xa6ea017771df6928 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df692f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351142.584398:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 000000006f46cee9/0xa6ea017771df6928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df692f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351142.584405:0:5803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789351142.584408:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789351142.584412:0:5803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d2cc5fed000 10000000:01000000:0.0:1789351142.584414:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789351142.584416:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789351142.584418:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789351142.584430:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000b6f5847d/0xa6ea017771df6936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351142.584445:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000b6f5847d/0xa6ea017771df6936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351142.584452:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000b6f5847d/0xa6ea017771df6936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351142.584462:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000310c66ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626374400:0@lo:101: 00000100:00100000:0.0:1789351142.584484:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351142.584509:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 00000000db21197c going to sleep for 11 seconds 00000100:00100000:2.0:1789351142.584514:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626374400 00000100:00100000:2.0:1789351142.584518:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626374400 00000100:00100000:2.0:1789351142.584549:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789351142.584555:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a02d6cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+7:5803:x1876270626374400:12345-0@lo:101: 00010000:00010000:2.0:1789351142.584561:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351142.584568:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a9b2f1f4/0xa6ea017771df693d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6936 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.584580:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a9b2f1f4/0xa6ea017771df693d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6936 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.584586:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a9b2f1f4/0xa6ea017771df693d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6936 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.584592:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a9b2f1f4, rc 0) 00000100:00100000:2.0:1789351142.584629:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a02d6cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+8:5803:x1876270626374400:12345-0@lo:101: Request processed in 75us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351142.584635:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789351142.584696:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000310c66ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626374400:0@lo:101: 00010000:00010000:3.0:1789351142.584707:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000b6f5847d/0xa6ea017771df6936 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df693d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.584711:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000b6f5847d/0xa6ea017771df6936 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df693d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351142.584746:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000858ea8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626374528:0@lo:501: 00000100:00100000:3.0:1789351142.584764:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351142.584779:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 0000000048101ef4 going to sleep for 11 seconds 00000100:00100000:1.0:1789351142.584815:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626374528 00000100:00100000:1.0:1789351142.584818:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626374528 00000100:00100000:1.0:1789351142.584859:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789351142.584863:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000355da90f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+8:5803:x1876270626374528:12345-0@lo:501: 00000100:00100000:1.0:1789351142.585039:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000355da90f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+9:5803:x1876270626374528:12345-0@lo:501: Request processed in 175us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351142.585046:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789351142.585092:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000858ea8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626374528:0@lo:501: 00000100:00100000:3.0:1789351142.585115:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000858ea8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626374656:0@lo:503: 00000100:00100000:3.0:1789351142.585147:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351142.585166:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 0000000048101ef4 going to sleep for 11 seconds 00000100:00100000:0.0:1789351142.585187:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626374656 00000100:00100000:0.0:1789351142.585191:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626374656 00000100:00100000:0.0:1789351142.585215:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789351142.585220:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cdfb720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+9:5803:x1876270626374656:12345-0@lo:503: 00000100:00100000:1.0:1789351142.585761:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cdfb720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+9:5803:x1876270626374656:12345-0@lo:503: Request processed in 540us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351142.585765:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789351142.585825:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000858ea8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626374656:0@lo:503: 00000100:00100000:3.0:1789351142.586047:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000858ea8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:5845:1876270626374784:0@lo:502: 00000100:00100000:3.0:1789351142.586077:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351142.586101:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set 0000000061f06513 going to sleep for 11 seconds 00000100:00100000:1.0:1789351142.586138:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626374784 00000100:00100000:1.0:1789351142.586141:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626374784 00000100:00100000:1.0:1789351142.586161:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789351142.586167:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026b7ce73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+9:5845:x1876270626374784:12345-0@lo:502: 00000100:00100000:1.0:1789351142.586385:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026b7ce73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+9:5845:x1876270626374784:12345-0@lo:502: Request processed in 218us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351142.586390:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789351142.586445:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000858ea8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:5845:1876270626374784:0@lo:502: 00000020:01000000:3.0:1789351142.586461:0:5845:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789351142.586469:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351142.586471:0:5845:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789351142.586476:0:5845:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789351142.586482:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789351142.586493:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000007a4595cb) 00000020:00000080:3.0:1789351142.586506:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789351142.586509:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789351142.586563:0:5845:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789351142.586569:0:5845:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6ea017771df694b 00000020:00000080:3.0:1789351142.586731:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789351142.586734:0:5845:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351142.586736:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351142.586737:0:5845:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789351142.586738:0:5845:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789351142.586740:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351142.586741:0:5845:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789351142.586743:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789351142.586747:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000406ba8e4) 00000020:00000080:3.0:1789351142.586754:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789351142.586756:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789351142.586757:0:5845:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789351142.586759:0:5845:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789351142.586762:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789351142.586798:0:5845:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c9ac87bb from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789351142.586805:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000009ee4476e) 00000020:00000080:3.0:1789351142.586810:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789351142.586838:0:5845:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789351142.586840:0:5845:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6ea017771df6960 00000020:00000080:3.0:1789351142.586898:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789351142.586901:0:5845:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789351142.586904:0:5845:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa6ea017771df6967 00080000:01000000:3.0:1789351142.586906:0:5845:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789351142.586908:0:5845:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6ea017771df696e 00080000:10000000:3.0:1789351142.587190:0:5845:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1789351142.587477:0:5845:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789351142.590397:0:5845:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789351142.631714:0:5845:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789351142.631955:0:5845:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789351142.633600:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789351142.633773:0:5845:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789351142.652217:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000171d213c) 00000020:00000080:0.0:1789351142.652240:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789351142.652936:0:5845:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789351142.652944:0:5845:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6ea017771df697c 00000020:00000080:1.0:1789351142.653343:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789351142.654583:0:5845:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789351142.683233:0:5845:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789351142.715758:0:5845:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789351142.736712:0:5845:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789351142.763221:0:5845:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789351142.781313:0:5845:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1789351142.798317:0:5845:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa6ea017771df6983 00000020:00000080:2.0:1789351142.798584:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789351142.798593:0:5845:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789351142.798599:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351142.798601:0:5845:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789351142.798604:0:5845:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789351142.798607:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351142.798608:0:5845:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789351142.798611:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789351142.798612:0:5845:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789351142.798614:0:5845:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789351142.798616:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351142.798618:0:5845:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789351142.798619:0:5845:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789351142.798623:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351142.798624:0:5845:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789351142.798627:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789351142.798665:0:5845:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1789351142.798715:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006f54601b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:5845:1876270626374912:0@lo:502: 00000100:00100000:2.0:1789351142.798787:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351142.798836:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set 00000000402d8993 going to sleep for 11 seconds 00000100:00100000:1.0:1789351142.798917:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626374912 00000100:00100000:1.0:1789351142.798924:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626374912 00000100:00100000:1.0:1789351142.798960:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789351142.798975:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b49e9607 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+9:5845:x1876270626374912:12345-0@lo:502: 00000100:00100000:1.0:1789351142.799300:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b49e9607 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+9:5845:x1876270626374912:12345-0@lo:502: Request processed in 325us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351142.799307:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789351142.799386:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006f54601b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:5845:1876270626374912:0@lo:502: 00000020:01000000:3.0:1789351142.799407:0:5845:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351142.799411:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351142.799412:0:5845:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1789351142.799416:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789351142.799576:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789351142.799590:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789351142.799611:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000b6f5847d/0xa6ea017771df6936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df693d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351142.799621:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000b6f5847d/0xa6ea017771df6936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df693d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351142.799629:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d2cc5fed000 from 1 10000000:01000000:1.0:1789351142.799631:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789351142.799662:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 000000003de5edb3/0xa6ea017771df698a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351142.799669:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 000000003de5edb3/0xa6ea017771df698a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351142.799676:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 000000003de5edb3/0xa6ea017771df698a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351142.799686:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ecea962a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626375040:0@lo:101: 00000100:00100000:1.0:1789351142.799710:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351142.799735:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 0000000030d57192 going to sleep for 11 seconds 00000100:00100000:3.0:1789351142.799781:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626375040 00000100:00100000:3.0:1789351142.799785:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626375040 00000100:00100000:3.0:1789351142.799810:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789351142.799815:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea251138 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+9:5803:x1876270626375040:12345-0@lo:101: 00010000:00010000:3.0:1789351142.799823:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351142.799834:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000693ed126/0xa6ea017771df6991 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df698a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.799852:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000693ed126/0xa6ea017771df6991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df698a expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.799860:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000693ed126/0xa6ea017771df6991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df698a expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.799868:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000693ed126, rc 0) 00000100:00100000:3.0:1789351142.799891:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea251138 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:5803:x1876270626375040:12345-0@lo:101: Request processed in 77us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351142.799896:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789351142.799958:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ecea962a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626375040:0@lo:101: 00010000:00010000:1.0:1789351142.799978:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 000000003de5edb3/0xa6ea017771df698a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6991 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351142.799986:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 000000003de5edb3/0xa6ea017771df698a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6991 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351142.800611:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ecea962a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626375168:0@lo:256: 00000100:00100000:1.0:1789351142.800641:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351142.800698:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 0000000030d57192 going to sleep for 11 seconds 00000100:00100000:3.0:1789351142.800804:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626375168 00000100:00100000:3.0:1789351142.800809:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626375168 00000100:00100000:3.0:1789351142.800856:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789351142.800862:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b260dd21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+10:5803:x1876270626375168:12345-0@lo:256: 20000000:01000000:3.0:1789351142.800874:0:5817:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789351142.800878:0:5817:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789351142.801072:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b260dd21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+10:5803:x1876270626375168:12345-0@lo:256: Request processed in 210us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351142.801079:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789351142.801143:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ecea962a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626375168:0@lo:256: 10000000:01000000:0.0:1789351142.801883:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789351142.801931:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 000000003de5edb3/0xa6ea017771df698a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6991 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351142.801939:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 000000003de5edb3/0xa6ea017771df698a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6991 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351142.801946:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2cc5fed000 from 1 10000000:01000000:0.0:1789351142.801953:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789351142.801983:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6998 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351142.801991:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6998 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351142.801997:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6998 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351142.802008:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008f6c82f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626375296:0@lo:101: 00000100:00100000:0.0:1789351142.802036:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351142.802062:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 000000002e321b15 going to sleep for 11 seconds 00000100:00100000:1.0:1789351142.802119:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626375296 00000100:00100000:1.0:1789351142.802123:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626375296 00000100:00100000:1.0:1789351142.802147:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789351142.802152:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c4acf07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+10:5803:x1876270626375296:12345-0@lo:101: 00010000:00010000:1.0:1789351142.802160:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351142.802169:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ac1a39c8/0xa6ea017771df699f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6998 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351142.802182:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ac1a39c8/0xa6ea017771df699f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6998 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351142.802189:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ac1a39c8/0xa6ea017771df699f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6998 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351142.802196:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ac1a39c8, rc 0) 00000100:00100000:1.0:1789351142.802239:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c4acf07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+11:5803:x1876270626375296:12345-0@lo:101: Request processed in 86us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351142.802244:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789351142.802311:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008f6c82f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626375296:0@lo:101: 00010000:00010000:0.0:1789351142.802321:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6998 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df699f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351142.802328:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6998 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df699f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351142.802385:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008f6c82f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626375424:0@lo:501: 00000100:00100000:0.0:1789351142.802407:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351142.802428:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 000000002e321b15 going to sleep for 11 seconds 00000100:00100000:3.0:1789351142.802494:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626375424 00000100:00100000:3.0:1789351142.802499:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626375424 00000100:00100000:3.0:1789351142.802519:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789351142.802525:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061c4b833 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:5803:x1876270626375424:12345-0@lo:501: 00000100:00100000:3.0:1789351142.803033:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061c4b833 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:5803:x1876270626375424:12345-0@lo:501: Request processed in 508us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351142.803040:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789351142.803207:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008f6c82f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626375424:0@lo:501: 00000100:00100000:0.0:1789351142.803236:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008f6c82f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626375552:0@lo:503: 00000100:00100000:0.0:1789351142.803274:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351142.803300:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 000000002e321b15 going to sleep for 11 seconds 00000100:00100000:3.0:1789351142.803349:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626375552 00000100:00100000:3.0:1789351142.803354:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626375552 00000100:00100000:3.0:1789351142.803395:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789351142.803401:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b664465 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:5803:x1876270626375552:12345-0@lo:503: 00000040:00080000:3.0:1789351142.803431:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789351142.803466:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b664465 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:5803:x1876270626375552:12345-0@lo:503: Request processed in 65us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351142.803473:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789351142.803590:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008f6c82f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626375552:0@lo:503: 00000040:00080000:0.0:1789351142.804603:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789351142.804780:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789351142.804796:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789351142.805007:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6998 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df699f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351142.805018:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df699f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351142.805059:0:5803:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789351142.805061:0:5803:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2cc5fed000 10000000:01000000:1.0:1789351142.805063:0:5803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2cc5fed000 10000000:01000000:1.0:1789351142.805072:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789351142.805076:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d2cc5fed000 from 1 10000000:01000000:1.0:1789351142.805077:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789351142.805097:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 0000000086e09514/0xa6ea017771df69a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351142.805102:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 0000000086e09514/0xa6ea017771df69a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351142.805109:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 0000000086e09514/0xa6ea017771df69a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351142.805119:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001dee8be6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626375680:0@lo:101: 00000100:00100000:1.0:1789351142.805152:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351142.805179:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 0000000038e23ca1 going to sleep for 11 seconds 00000100:00100000:3.0:1789351142.805183:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626375680 00000100:00100000:3.0:1789351142.805189:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626375680 00000100:00100000:3.0:1789351142.805286:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789351142.805294:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a81acf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:5803:x1876270626375680:12345-0@lo:101: 00010000:00010000:3.0:1789351142.805311:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351142.805321:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000008955036/0xa6ea017771df69ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df69a6 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.805340:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000008955036/0xa6ea017771df69ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df69a6 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.805350:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000008955036/0xa6ea017771df69ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df69a6 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.805444:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000008955036, rc 0) 00000100:00100000:3.0:1789351142.805475:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a81acf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5803:x1876270626375680:12345-0@lo:101: Request processed in 182us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351142.805481:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789351142.805781:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001dee8be6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626375680:0@lo:101: 00010000:00010000:1.0:1789351142.805790:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 0000000086e09514/0xa6ea017771df69a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df69ad expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351142.805796:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 0000000086e09514/0xa6ea017771df69a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df69ad expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351142.805827:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001dee8be6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626375808:0@lo:501: 00000100:00100000:1.0:1789351142.805843:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351142.805865:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 0000000038e23ca1 going to sleep for 11 seconds 00000100:00100000:2.0:1789351142.805878:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626375808 00000100:00100000:2.0:1789351142.805882:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626375808 00000100:00100000:2.0:1789351142.805912:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789351142.805919:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a4671cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5803:x1876270626375808:12345-0@lo:501: 00000100:00100000:2.0:1789351142.806149:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a4671cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5803:x1876270626375808:12345-0@lo:501: Request processed in 231us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351142.806156:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789351142.806283:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001dee8be6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626375808:0@lo:501: 00000100:00100000:1.0:1789351142.806301:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001dee8be6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626375936:0@lo:503: 00000100:00100000:1.0:1789351142.806325:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351142.806344:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 0000000038e23ca1 going to sleep for 11 seconds 00000100:00100000:3.0:1789351142.806459:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626375936 00000100:00100000:3.0:1789351142.806464:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626375936 00000100:00100000:3.0:1789351142.806482:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789351142.806487:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bacb1fe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5803:x1876270626375936:12345-0@lo:503: 00000100:00100000:3.0:1789351142.806746:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bacb1fe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5803:x1876270626375936:12345-0@lo:503: Request processed in 259us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351142.806754:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789351142.806802:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001dee8be6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626375936:0@lo:503: 00000100:00100000:3.0:1789351142.807490:0:5850:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000858ea8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:5850:1876270626376064:0@lo:502: 00000100:00100000:3.0:1789351142.807528:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351142.807556:0:5850:0:(client.c:2702:ptlrpc_set_wait()) set 0000000061f06513 going to sleep for 11 seconds 00000100:00100000:2.0:1789351142.807595:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626376064 00000100:00100000:2.0:1789351142.807606:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626376064 00000100:00100000:2.0:1789351142.807676:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789351142.807684:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b73e42a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5850:x1876270626376064:12345-0@lo:502: 00000100:00100000:2.0:1789351142.807881:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b73e42a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5850:x1876270626376064:12345-0@lo:502: Request processed in 198us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351142.807888:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789351142.807950:0:5850:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000858ea8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:5850:1876270626376064:0@lo:502: 00000020:01000004:3.0:1789351142.808015:0:5850:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789351142.808038:0:5850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000cb80fe32) 00000020:00000080:3.0:1789351142.808057:0:5850:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789351142.808224:0:5850:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c9ac87bb from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789351142.808229:0:5850:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c9ac87bb from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789351142.808231:0:5850:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c9ac87bb 4 00010000:00080000:3.0:1789351142.808258:0:5850:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000483473ee@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1789351142.809881:0:5850:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789351142.810002:0:5850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789351142.810032:0:5850:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789351142.810043:0:5850:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa6ea017771df69bb 00000100:00080000:3.0:1789351142.810051:0:5850:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789351142.810056:0:5850:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000483473ee using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789351142.810086:0:5850:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000858ea8a x1876270626376192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789351142.810107:0:5850:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789351142.810394:0:5850:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b33ca33b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:5850:1876270626376320:0@lo:502: 00000100:00100000:1.0:1789351142.810462:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351142.810493:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626376320 00000100:00100000:1.0:1789351142.810499:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626376320 00000100:00100000:1.0:1789351142.810531:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789351142.810539:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a934dd1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5850:x1876270626376320:12345-0@lo:502: 00000100:00100000:1.0:1789351142.810726:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a934dd1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5850:x1876270626376320:12345-0@lo:502: Request processed in 188us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351142.810733:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789351142.810830:0:5850:0:(client.c:2702:ptlrpc_set_wait()) set 00000000de429e6a going to sleep for 11 seconds 00000100:00100000:1.0:1789351142.810846:0:5850:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b33ca33b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:5850:1876270626376320:0@lo:502: 00000040:00080000:1.0:1789351142.810870:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:0.0:1789351142.812493:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000858ea8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876270626376192:0@lo:38: 00000100:00100000:0.0:1789351142.812549:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1789351142.812600:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789351142.812623:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789351142.812638:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 0000000086e09514/0xa6ea017771df69a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df69ad expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351142.812650:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 0000000086e09514/0xa6ea017771df69a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df69ad expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789351142.812694:0:5803:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789351142.812696:0:5803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789351142.812697:0:5803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789351142.812699:0:5803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789351142.812700:0:5803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789351142.812701:0:5803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789351142.812702:0:5803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789351142.812703:0:5803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789351142.812704:0:5803:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789351142.812705:0:5803:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789351142.812707:0:5803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789351142.812708:0:5803:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789351142.812711:0:5803:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789351142.812714:0:5803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789351142.812715:0:5803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789351142.812716:0:5803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789351142.812717:0:5803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789351142.812718:0:5803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789351142.812720:0:5803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789351142.812720:0:5803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789351142.812721:0:5803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789351142.812722:0:5803:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789351142.812728:0:5803:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789351142.812729:0:5803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789351142.812730:0:5803:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789351142.812748:0:5803:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789351142.812759:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000074dd2416 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626376448:0@lo:253: 00000100:00100000:0.0:1789351142.812790:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351142.812807:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 0000000029d6f31d going to sleep for 11 seconds 00000100:00100000:0.0:1789351142.812827:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626376448 00000100:00100000:0.0:1789351142.812832:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626376448 00000100:00100000:0.0:1789351142.812864:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789351142.812871:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c743bd4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5803:x1876270626376448:12345-0@lo:253: 20000000:01000000:0.0:1789351142.812894:0:5817:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789351142.812907:0:5817:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789351142.813851:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626376192 00000100:00100000:1.0:1789351142.813856:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626376192 00000100:00100000:1.0:1789351142.813879:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789351142.813883:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f6c82f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1876270626376192:12345-0@lo:38: 00000100:00100000:1.0:1789351142.813928:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f6c82f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1876270626376192:12345-0@lo:38: Request processed in 45us (1380us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789351142.813932:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351142.815379:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789351142.815389:0:3285:0:(import.c:65:import_set_state_nolock()) 00000000483473ee lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789351142.815394:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789351142.815398:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000858ea8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876270626376192:0@lo:38: 20000000:01000000:1.0:1789351142.827475:0:5817:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789351142.827492:0:5817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789351142.827499:0:5838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789351142.827503:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789351142.827521:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f899f843/0xa6ea017771df69c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.827541:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000693ed126/0xa6ea017771df6991 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df698a expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.827549:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f899f843/0xa6ea017771df69c2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.827584:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000693ed126/0xa6ea017771df6991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df698a expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.827598:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000693ed126/0xa6ea017771df6991 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df698a expref: 12 pid: 5814 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351142.827614:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000d5887c7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1876270626376576:0@lo:104: 00000100:00100000:2.0:1789351142.827678:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351142.827730:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set 00000000402d8993 going to sleep for 11 seconds 00000100:00100000:1.0:1789351142.827738:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626376576 00000100:00100000:1.0:1789351142.827745:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626376576 00000100:00100000:1.0:1789351142.827792:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789351142.827799:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eddd41a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+3:5838:x1876270626376576:12345-0@lo:104: 00010000:00010000:1.0:1789351142.827810:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 000000003de5edb3/0xa6ea017771df698a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6991 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351142.827875:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789351142.827881:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eddd41a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+3:5838:x1876270626376576:12345-0@lo:104: Request processed in 82us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351142.827887:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789351142.827897:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000d5887c7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1876270626376576:0@lo:104: 00010000:00010000:2.0:1789351142.827915:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f899f843/0xa6ea017771df69c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.827972:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351142.827978:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 000000003de5edb3/0xa6ea017771df698a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6991 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.827985:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003de5edb3 already unused, calling callback (00000000010997cd) 10000000:00010000:3.0:1789351142.827988:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 000000003de5edb3/0xa6ea017771df698a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6991 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.827995:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 000000003de5edb3/0xa6ea017771df698a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6991 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789351142.828001:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 000000003de5edb3/0xa6ea017771df698a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6991 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351142.828007:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789351142.828041:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 000000003de5edb3/0xa6ea017771df698a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6991 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.828047:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789351142.828062:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 000000003de5edb3/0xa6ea017771df698a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6991 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.828069:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 000000003de5edb3/0xa6ea017771df698a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6991 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.828082:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351142.828084:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351142.828085:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351142.828162:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000003d25421 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626376704:0@lo:103: 00000100:00100000:3.0:1789351142.828189:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351142.828342:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626376704 00000100:00100000:3.0:1789351142.828346:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626376704 00010000:00010000:3.0:1789351142.828584:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000693ed126/0xa6ea017771df6991 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df698a expref: 13 pid: 5814 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351142.828638:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789351142.828645:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000af1c9d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:3287:x1876270626376704:12345-0@lo:103: 00010000:00010000:3.0:1789351142.828655:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351142.828659:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000693ed126/0xa6ea017771df6991 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df698a expref: 13 pid: 5814 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.828679:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000693ed126/0xa6ea017771df6991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df698a expref: 13 pid: 5814 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.828692:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000693ed126/0xa6ea017771df6991 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df698a expref: 13 pid: 5814 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.828710:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f899f843/0xa6ea017771df69c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.828717:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f899f843/0xa6ea017771df69c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789351142.828730:0:5807:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001227379s 00010000:00010000:3.0:1789351142.828733:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f899f843/0xa6ea017771df69c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.828739:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f899f843/0xa6ea017771df69c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.828745:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f899f843/0xa6ea017771df69c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.828750:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f899f843/0xa6ea017771df69c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.828755:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f899f843 already unused, calling callback (000000004b1ccba6) 00010000:00010000:3.0:1789351142.828758:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f899f843/0xa6ea017771df69c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.828764:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f899f843/0xa6ea017771df69c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.828779:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f899f843/0xa6ea017771df69c2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351142.828789:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351142.828796:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f899f843/0xa6ea017771df69c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.828803:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f899f843/0xa6ea017771df69c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351142.828808:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f899f843/0xa6ea017771df69c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351142.828818:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000af1c9d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+12:3287:x1876270626376704:12345-0@lo:103: Request processed in 175us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351142.828824:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789351142.828936:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000003d25421 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626376704:0@lo:103: 00000100:00100000:0.0:1789351142.831410:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000074dd2416 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:5803:1876270626376448:0@lo:253: 10000000:01000000:0.0:1789351142.831427:0:5803:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789351142.831430:0:5803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789351142.831432:0:5803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789351142.831433:0:5803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789351142.831434:0:5803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789351142.831435:0:5803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789351142.831437:0:5803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789351142.831438:0:5803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789351142.831439:0:5803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789351142.831441:0:5803:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789351142.831442:0:5803:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789351142.831443:0:5803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789351142.831445:0:5803:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789351142.831457:0:5803:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789351142.831462:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c743bd4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:5803:x1876270626376448:12345-0@lo:253: Request processed in 18482us (18562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351142.831471:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00080000:10000000:0.0:1789351142.834548:0:5803:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789351142.834928:0:5803:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789351142.835284:0:5803:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789351142.835482:0:5803:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789351142.835675:0:5803:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789351142.835868:0:5803:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789351142.836708:0:5803:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789351142.836831:0:5803:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789351142.836949:0:5803:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789351142.837116:0:5803:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789351142.837373:0:5803:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789351142.837546:0:5803:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789351142.859855:0:5803:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789351142.875620:0:5803:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789351142.875671:0:5855:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789351142.875675:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789351142.875843:0:5856:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789351142.878207:0:5803:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789351142.878418:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789351142.878848:0:5803:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789351142.878854:0:5803:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789351142.878932:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789351142.879953:0:5803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789351142.880562:0:5803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789351142.880587:0:5803:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789351142.880747:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789351142.880911:0:5803:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789351142.882196:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789351142.882331:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789351142.882614:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789351142.882776:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789351142.882903:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789351142.883060:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789351142.883226:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789351142.883404:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789351142.883551:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789351142.883749:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789351142.883901:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789351142.884062:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789351142.884193:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789351142.884338:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789351142.884512:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789351142.884680:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789351142.884939:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789351142.885094:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789351142.885351:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789351142.885513:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789351142.885659:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789351142.885809:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789351142.885947:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789351142.886121:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789351142.886273:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789351142.886465:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789351142.886613:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789351142.886766:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789351142.886879:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789351142.887810:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789351142.887941:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789351142.888095:0:5803:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789351142.888253:0:5803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1789351142.897894:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789351142.925898:0:5803:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789351142.925936:0:5803:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb764816a3988 00100000:10000000:2.0:1789351142.925944:0:5803:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789351142.926653:0:5803:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789351142.926669:0:5803:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789351142.926685:0:5803:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1789351142.926706:0:5803:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1789351142.947392:0:5856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789351142.947452:0:5856:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789351142.947458:0:5856:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789351143.393602:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351144.418654:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789351145.229617:0:6098:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789351145.442560:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351146.465454:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351147.489538:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789351148.193948:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789351148.193959:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789351148.193963:0:36:0:(import.c:65:import_set_state_nolock()) 00000000483473ee lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789351148.193976:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000483473ee using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789351148.194002:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003b71dc4a x1876270626376960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789351148.194044:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003b71dc4a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876270626376960:0@lo:38: 00000100:00100000:0.0:1789351148.194138:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351148.194203:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626376960 00000100:00100000:3.0:1789351148.194212:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626376960 00000100:00100000:3.0:1789351148.194297:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789351148.194305:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000dce77d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1876270626376960:12345-0@lo:38: 00010000:00080000:3.0:1789351148.194329:0:5824:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 92 last 0 00000100:00100000:2.0:1789351148.194430:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000074dd2416 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626376832:0@lo:400: 00000020:00000080:1.0:1789351148.194464:0:5824:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa6ea017771df69c9 00000100:00100000:2.0:1789351148.194474:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351148.194502:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626376832 00000004:00100000:1.0:1789351148.194506:0:5824:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1789351148.194508:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626376832 00000100:00100000:3.0:1789351148.194555:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789351148.194563:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002663ff3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+11:3288:x1876270626376832:12345-0@lo:400: 00000100:00100000:3.0:1789351148.194618:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002663ff3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+11:3288:x1876270626376832:12345-0@lo:400: Request processed in 56us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351148.194625:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789351148.194631:0:5824:0:(import.c:65:import_set_state_nolock()) 00000000b8eee66f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789351148.194717:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000074dd2416 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626376832:0@lo:400: 00000100:00100000:1.0:1789351148.194745:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000dce77d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876270626376960:12345-0@lo:38: Request processed in 439us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351148.194755:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789351148.194829:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003b71dc4a x1876270626376960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789351158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789351148.194840:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789351148.194856:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789351148.194859:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789351148.194861:0:3285:0:(import.c:65:import_set_state_nolock()) 00000000483473ee lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789351148.194870:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003b71dc4a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876270626376960:0@lo:38: 00000020:00000080:1.0:1789351148.496728:0:6301:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd080e50e0 20000000:00000080:1.0:1789351148.496745:0:6301:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2cefc14800 uarg=0000000000000000 20000000:01000000:1.0:1789351148.496780:0:6301:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789351148.496787:0:6301:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789351148.496791:0:6301:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789351148.497021:0:6301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789351148.497031:0:6301:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1789351148.500007:0:6301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789351148.500324:0:6301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789351148.500562:0:6301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1789351148.500630:0:6301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1789351148.500651:0:6301:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789351148.500668:0:6301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000055b9cb9d/0xa6ea017771df69d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351148.500687:0:6301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ac1a39c8/0xa6ea017771df699f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6998 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351148.500694:0:6301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000055b9cb9d/0xa6ea017771df69d0 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351148.500731:0:6301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ac1a39c8/0xa6ea017771df699f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6998 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351148.500750:0:6301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ac1a39c8/0xa6ea017771df699f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6998 expref: 10 pid: 5816 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351148.500764:0:6301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b33ca33b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6301:1876270626377088:0@lo:104: 00000100:00100000:1.0:1789351148.500840:0:6301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351148.500965:0:6301:0:(client.c:2702:ptlrpc_set_wait()) set 00000000000b09ca going to sleep for 11 seconds 00000100:00100000:3.0:1789351148.501040:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626377088 00000100:00100000:3.0:1789351148.501047:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626377088 00000100:00100000:3.0:1789351148.501097:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789351148.501106:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002b729d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+3:6301:x1876270626377088:12345-0@lo:104: 00010000:00010000:3.0:1789351148.501181:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df699f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351148.501450:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789351148.501457:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002b729d1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+3:6301:x1876270626377088:12345-0@lo:104: Request processed in 352us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351148.501466:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789351148.501473:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789351148.501483:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df699f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351148.501490:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ed5c54d3 already unused, calling callback (00000000010997cd) 10000000:00010000:0.0:1789351148.501493:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6998 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df699f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351148.501498:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df699f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789351148.501503:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6998 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df699f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351148.501506:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789351148.501577:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6998 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df699f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351148.501582:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789351148.501600:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6998 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df699f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351148.501604:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6998 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df699f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351148.501616:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351148.501617:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351148.501618:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789351148.501630:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789351148.501642:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000053803b6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626377216:0@lo:103: 00000100:00100000:2.0:1789351148.501673:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351148.501713:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626377216 00000100:00100000:0.0:1789351148.501718:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626377216 00010000:00010000:0.0:1789351148.501740:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ac1a39c8/0xa6ea017771df699f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6998 expref: 11 pid: 5816 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351148.501782:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789351148.501787:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d5887c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:3288:x1876270626377216:12345-0@lo:103: 00010000:00010000:0.0:1789351148.501795:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351148.501799:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ac1a39c8/0xa6ea017771df699f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6998 expref: 11 pid: 5816 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351148.501808:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ac1a39c8/0xa6ea017771df699f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6998 expref: 11 pid: 5816 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351148.501820:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000055b9cb9d/0xa6ea017771df69d0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351148.501824:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055b9cb9d/0xa6ea017771df69d0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351148.501832:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000055b9cb9d/0xa6ea017771df69d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351148.501836:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000055b9cb9d/0xa6ea017771df69d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351148.501841:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000055b9cb9d/0xa6ea017771df69d0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351148.501844:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000055b9cb9d/0xa6ea017771df69d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351148.501847:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000055b9cb9d already unused, calling callback (000000004b1ccba6) 00010000:00010000:0.0:1789351148.501849:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000055b9cb9d/0xa6ea017771df69d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351148.501858:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000055b9cb9d/0xa6ea017771df69d0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351148.501862:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000055b9cb9d/0xa6ea017771df69d0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351148.501869:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789351148.501906:0:6301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ac1a39c8/0xa6ea017771df699f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6998 expref: 11 pid: 5816 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351148.501913:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d5887c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:3288:x1876270626377216:12345-0@lo:103: Request processed in 125us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351148.501924:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789351148.501927:0:6301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b33ca33b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6301:1876270626377088:0@lo:104: 00010000:00010000:1.0:1789351148.501945:0:6301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000055b9cb9d/0xa6ea017771df69d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351148.501955:0:6301:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000055b9cb9d/0xa6ea017771df69d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351148.501960:0:6301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000055b9cb9d/0xa6ea017771df69d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351148.501966:0:6301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000055b9cb9d/0xa6ea017771df69d0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351148.502812:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000053803b6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626377216:0@lo:103: 00010000:00010000:0.0:1789351148.513485:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351149.537709:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351150.562421:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351151.585598:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789351151.979692:0:6658:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789351151.979697:0:6658:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789351151.979847:0:6658:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000404e9f3a 00000020:01000004:0.0:1789351151.979863:0:6658:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789351151.979874:0:6658:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789351151.979888:0:6658:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000c767510d) 00000020:00000080:0.0:1789351151.979904:0:6658:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789351151.990603:0:6658:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789351151.992634:0:6658:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789351152.005420:0:6658:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1789351152.007839:0:6658:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789351152.007858:0:6658:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1789351152.007889:0:6658:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789351152.007903:0:6658:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1789351152.008211:0:6658:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789351152.008227:0:6658:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789351152.008237:0:6658:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa6ea017771df69de 00000020:01000004:0.0:1789351152.008244:0:6658:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1789351152.008264:0:6658:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789351152.008267:0:6658:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789351152.008272:0:6658:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789351152.008277:0:6658:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789351152.008287:0:6658:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000054eb2a05) 00000020:00000080:0.0:1789351152.008298:0:6658:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1789351152.009574:0:6658:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789351152.009699:0:6658:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789351152.009705:0:6658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789351152.009988:0:6658:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789351152.009993:0:6658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789351152.011103:0:6658:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789351152.011111:0:6658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789351152.012946:0:6658:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789351152.013096:0:6658:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789351152.013101:0:6658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789351152.013810:0:6658:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789351152.013825:0:6658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789351152.027592:0:6658:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789351152.027828:0:6658:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789351152.027835:0:6658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789351152.031514:0:6658:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789351152.031526:0:6658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789351152.031999:0:6658:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789351152.032005:0:6658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789351152.034407:0:6658:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789351152.034571:0:6658:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789351152.034577:0:6658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789351152.035147:0:6658:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789351152.035154:0:6658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789351152.066663:0:6658:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789351152.066840:0:6658:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789351152.066846:0:6658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789351152.067536:0:6658:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789351152.067541:0:6658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789351152.067806:0:6658:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789351152.067834:0:6658:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789351152.067844:0:6658:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789351152.079743:0:6658:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789351152.079773:0:6658:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.152@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789351152.079776:0:6658:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789351152.079777:0:6658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789351152.079778:0:6658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789351152.079779:0:6658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789351152.079780:0:6658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789351152.079781:0:6658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789351152.079782:0:6658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789351152.079783:0:6658:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789351152.079783:0:6658:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789351152.079784:0:6658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789351152.079785:0:6658:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789351152.079788:0:6658:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789351152.079789:0:6658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789351152.079790:0:6658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789351152.079790:0:6658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789351152.079791:0:6658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789351152.079792:0:6658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789351152.079792:0:6658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789351152.079793:0:6658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789351152.079793:0:6658:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789351152.079794:0:6658:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789351152.079794:0:6658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789351152.079795:0:6658:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789351152.079831:0:6658:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789351152.079847:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626377344:0@lo:253: 00000100:00100000:2.0:1789351152.079907:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351152.080001:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626377344 00000100:00100000:1.0:1789351152.080009:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626377344 00000100:00100000:2.0:1789351152.080014:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set 00000000963aa8f2 going to sleep for 11 seconds 00000100:00100000:1.0:1789351152.080059:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789351152.080075:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a52a0c65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+10:6658:x1876270626377344:12345-0@lo:253: 20000000:01000000:1.0:1789351152.080115:0:5817:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789351152.080120:0:5817:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789351152.080124:0:5817:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789351152.080126:0:5817:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789351152.080666:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789351152.080812:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789351152.080842:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789351152.080881:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1789351152.080886:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789351152.080905:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1789351152.080934:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1789351152.081138:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789351152.081169:0:5817:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.152@tcp 20000000:01000000:1.0:1789351152.081171:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:1.0:1789351152.081206:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789351152.081214:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789351152.081258:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789351152.081267:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:1.0:1789351152.081299:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789351152.081307:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789351152.081338:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789351152.081422:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1789351152.081951:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789351152.081962:0:5817:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.152@tcp 20000000:01000000:1.0:1789351152.081964:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:1.0:1789351152.081998:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789351152.082005:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789351152.082035:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789351152.082041:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:1.0:1789351152.082082:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789351152.082097:0:5817:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789351152.082130:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1789351152.082167:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1789351152.082182:0:5817:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1789351152.082185:0:5817:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1789351152.082191:0:5817:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789351152.082192:0:5817:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789351152.082194:0:5817:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789351152.082203:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789351152.082205:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789351152.082228:0:5817:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789351152.082230:0:5817:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789351152.083512:0:6673:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1789351152.083554:0:6673:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1789351152.083580:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789351152.083839:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1789351152.083882:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1789351152.083918:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1789351152.083929:0:5817:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789351152.083931:0:5817:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789351152.084286:0:6674:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789351152.084312:0:6674:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789351152.084352:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789351152.084587:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789351152.084619:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789351152.084673:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789351152.084687:0:5817:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789351152.084689:0:5817:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789351152.084968:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789351152.085087:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1789351152.085108:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1789351152.085138:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1789351152.085160:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789351152.085177:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005603bb32/0xa6ea017771df69ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.085192:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000091c7de22/0xa6ea017771df6921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df691a expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.085197:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a9b2f1f4/0xa6ea017771df693d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6936 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.085200:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000008955036/0xa6ea017771df69ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df69a6 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.085204:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005603bb32/0xa6ea017771df69ec lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.085241:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000008955036/0xa6ea017771df69ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df69a6 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.085251:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000008955036/0xa6ea017771df69ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df69a6 expref: 10 pid: 5817 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351152.085261:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f810ea69 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5817:1876270626377472:0@lo:104: 00000100:00100000:0.0:1789351152.085314:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351152.085352:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626377472 00010000:00010000:0.0:1789351152.085380:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a9b2f1f4/0xa6ea017771df693d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6936 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.085387:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a9b2f1f4/0xa6ea017771df693d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6936 expref: 10 pid: 5817 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351152.085395:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fa715d47 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5817:1876270626377600:0@lo:104: 00000100:00100000:0.0:1789351152.085416:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351152.085435:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626377472 00010000:00010000:0.0:1789351152.085439:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000091c7de22/0xa6ea017771df6921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df691a expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.085446:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000091c7de22/0xa6ea017771df6921 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df691a expref: 10 pid: 5814 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351152.085452:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000845e0561 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5817:1876270626377728:0@lo:104: 00000100:00100000:3.0:1789351152.085465:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626377600 00000100:00100000:3.0:1789351152.085468:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626377600 00000100:00100000:0.0:1789351152.085471:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351152.085477:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626377728 00000100:00100000:3.0:1789351152.085479:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626377728 00000100:00100000:0.0:1789351152.085480:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 0000000002c15a83 going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.085491:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789351152.085498:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000935b40c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+5:5817:x1876270626377472:12345-0@lo:104: 00010000:00010000:3.0:1789351152.085509:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 0000000086e09514/0xa6ea017771df69a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df69ad expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.085648:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789351152.085655:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000935b40c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+5:5817:x1876270626377472:12345-0@lo:104: Request processed in 157us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.085662:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789351152.085678:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789351152.085684:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000b0069c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+4:5817:x1876270626377600:12345-0@lo:104: 00010000:00010000:3.0:1789351152.085691:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 00000000b6f5847d/0xa6ea017771df6936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df693d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351152.085735:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f810ea69 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5817:1876270626377472:0@lo:104: 00010000:00010000:2.0:1789351152.085742:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789351152.085747:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 0000000086e09514/0xa6ea017771df69a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df69ad expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351152.085748:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fa715d47 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5817:1876270626377600:0@lo:104: 00010000:00010000:2.0:1789351152.085754:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000086e09514 already unused, calling callback (00000000010997cd) 10000000:00010000:2.0:1789351152.085757:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 0000000086e09514/0xa6ea017771df69a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df69ad expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.085764:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 0000000086e09514/0xa6ea017771df69a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df69ad expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789351152.085771:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 0000000086e09514/0xa6ea017771df69a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df69ad expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351152.085776:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789351152.085804:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 0000000086e09514/0xa6ea017771df69a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df69ad expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.085811:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789351152.085845:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 0000000086e09514/0xa6ea017771df69a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df69ad expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.085852:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 0000000086e09514/0xa6ea017771df69a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df69ad expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351152.085858:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789351152.085873:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084c18364 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626377856:0@lo:103: 00010000:00010000:2.0:1789351152.085875:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351152.085877:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 00000000b6f5847d/0xa6ea017771df6936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df693d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.085883:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b6f5847d already unused, calling callback (00000000010997cd) 10000000:00010000:2.0:1789351152.085889:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 00000000b6f5847d/0xa6ea017771df6936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df693d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.085895:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 00000000b6f5847d/0xa6ea017771df6936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df693d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351152.085898:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1789351152.085901:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 00000000b6f5847d/0xa6ea017771df6936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df693d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351152.085906:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789351152.085921:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 00000000b6f5847d/0xa6ea017771df6936 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df693d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.085926:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789351152.085926:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626377856 00000100:00100000:0.0:1789351152.085929:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626377856 00010000:00010000:2.0:1789351152.085933:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 00000000b6f5847d/0xa6ea017771df6936 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df693d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.085938:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 00000000b6f5847d/0xa6ea017771df6936 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df693d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.085944:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000008955036/0xa6ea017771df69ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df69a6 expref: 11 pid: 5817 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.085948:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351152.085949:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351152.085951:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351152.085963:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789351152.085969:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078070288 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+11:3287:x1876270626377856:12345-0@lo:103: 00010000:00010000:0.0:1789351152.085979:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351152.085983:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000008955036/0xa6ea017771df69ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df69a6 expref: 11 pid: 5817 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351152.085992:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1789351152.085992:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000008955036/0xa6ea017771df69ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df69a6 expref: 11 pid: 5817 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351152.086001:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007cd3181f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626377984:0@lo:103: 00010000:00010000:0.0:1789351152.086003:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000008955036/0xa6ea017771df69ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df69a6 expref: 11 pid: 5817 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.086015:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351152.086027:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351152.086033:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078070288 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:3287:x1876270626377856:12345-0@lo:103: Request processed in 65us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.086038:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789351152.086049:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626377984 00000100:00100000:0.0:1789351152.086053:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626377984 00010000:00010000:0.0:1789351152.086062:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a9b2f1f4/0xa6ea017771df693d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6936 expref: 10 pid: 5817 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351152.086075:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789351152.086080:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b33ca33b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:3286:x1876270626377984:12345-0@lo:103: 00010000:00010000:0.0:1789351152.086102:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351152.086106:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a9b2f1f4/0xa6ea017771df693d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6936 expref: 10 pid: 5817 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.086114:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a9b2f1f4/0xa6ea017771df693d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6936 expref: 10 pid: 5817 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.086124:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a9b2f1f4/0xa6ea017771df693d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6936 expref: 10 pid: 5817 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.086132:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351152.086145:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789351152.086150:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000b0069c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+4:5817:x1876270626377600:12345-0@lo:104: Request processed in 468us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.086156:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789351152.086171:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789351152.086177:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060b11354 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+3:5817:x1876270626377728:12345-0@lo:104: 00010000:00010000:3.0:1789351152.086184:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df691a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6921 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351152.086231:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b33ca33b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+9:3286:x1876270626377984:12345-0@lo:103: Request processed in 151us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.086238:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789351152.086267:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000845e0561 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5817:1876270626377728:0@lo:104: 00000100:00100000:0.0:1789351152.086267:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084c18364 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626377856:0@lo:103: 00010000:00010000:1.0:1789351152.086283:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005603bb32/0xa6ea017771df69ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351152.086286:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007cd3181f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626377984:0@lo:103: 00010000:00010000:2.0:1789351152.086318:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351152.086322:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df691a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6921 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.086329:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a582372 already unused, calling callback (00000000010997cd) 10000000:00010000:2.0:1789351152.086331:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df691a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6921 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.086346:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df691a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6921 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789351152.086352:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df691a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6921 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351152.086377:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789351152.086395:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df691a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6921 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.086402:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789351152.086421:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e80201f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626378112:0@lo:103: 00000100:00100000:0.0:1789351152.086445:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351152.086470:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626378112 00000100:00100000:1.0:1789351152.086474:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626378112 00010000:00010000:1.0:1789351152.086487:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000091c7de22/0xa6ea017771df6921 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df691a expref: 9 pid: 5814 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351152.086507:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789351152.086510:0:5807:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789351152.086513:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b792b7a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7166352-9951-4386-a0b0-6dc1f552d00a+9:3288:x1876270626378112:12345-0@lo:103: 00000100:00100000:0.0:1789351152.086517:0:5807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1789351152.086527:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351152.086531:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000091c7de22/0xa6ea017771df6921 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df691a expref: 9 pid: 5814 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.086539:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000091c7de22/0xa6ea017771df6921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df691a expref: 9 pid: 5814 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.086547:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000091c7de22/0xa6ea017771df6921 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df691a expref: 9 pid: 5814 timeout: 246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.086557:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005603bb32/0xa6ea017771df69ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.086563:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005603bb32/0xa6ea017771df69ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.086572:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005603bb32/0xa6ea017771df69ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.086577:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005603bb32/0xa6ea017771df69ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.086582:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005603bb32/0xa6ea017771df69ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.086587:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005603bb32/0xa6ea017771df69ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.086592:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005603bb32 already unused, calling callback (000000004b1ccba6) 00010000:00010000:1.0:1789351152.086595:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005603bb32/0xa6ea017771df69ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.086610:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005603bb32/0xa6ea017771df69ec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.086621:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005603bb32/0xa6ea017771df69ec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.086631:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351152.086663:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b792b7a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7166352-9951-4386-a0b0-6dc1f552d00a+8:3288:x1876270626378112:12345-0@lo:103: Request processed in 151us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351152.086670:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789351152.086686:0:5817:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005603bb32/0xa6ea017771df69ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.086692:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005603bb32/0xa6ea017771df69ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.086697:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005603bb32/0xa6ea017771df69ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789351152.086709:0:5817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789351152.086752:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e80201f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626378112:0@lo:103: 00010000:00010000:2.0:1789351152.086760:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df691a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6921 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.086767:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df691a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6921 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.086778:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351152.086779:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351152.086781:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351152.086866:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789351152.086872:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060b11354 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+3:5817:x1876270626377728:12345-0@lo:104: Request processed in 696us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.086878:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789351152.086908:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351152.108342:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a52a0c65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+7:6658:x1876270626377344:12345-0@lo:253: Request processed in 28260us (28425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351152.108381:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626377344:0@lo:253: 10000000:01000000:2.0:1789351152.108399:0:6658:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789351152.108402:0:6658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789351152.108404:0:6658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789351152.108406:0:6658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789351152.108407:0:6658:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789351152.108408:0:6658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789351152.108410:0:6658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789351152.108411:0:6658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789351152.108426:0:6658:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000100:00100000:0.0:1789351152.108426:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000020:01000004:2.0:1789351152.108427:0:6658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789351152.108428:0:6658:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789351152.108456:0:6658:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000404e9f3a from lustre-OST0000 10000000:01000000:2.0:1789351152.108481:0:6658:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789351152.108483:0:6658:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789351152.108490:0:6658:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2cd83919c0 local copy 10000000:01000000:2.0:1789351152.108494:0:6658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789351152.108524:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df69f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.108534:0:6658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df69f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.108541:0:6658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df69f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351152.108555:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626378240:0@lo:101: 00000100:00100000:2.0:1789351152.108583:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351152.108703:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626378240 00000100:00100000:1.0:1789351152.108710:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626378240 00000100:00100000:1.0:1789351152.108749:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789351152.108757:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee523cde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+7:6658:x1876270626378240:12345-0@lo:101: 00010000:00010000:1.0:1789351152.108770:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351152.108782:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000084c4e4b8/0xa6ea017771df69fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df69f3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.108804:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000084c4e4b8/0xa6ea017771df69fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df69f3 expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.108835:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000084c4e4b8/0xa6ea017771df69fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df69f3 expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.108843:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000084c4e4b8, rc 0) 00000100:00100000:1.0:1789351152.108871:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee523cde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+8:6658:x1876270626378240:12345-0@lo:101: Request processed in 115us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351152.108875:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789351152.108962:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b41b3375 going to sleep for 11 seconds 00000100:00100000:2.0:1789351152.108972:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626378240:0@lo:101: 00010000:00010000:2.0:1789351152.108980:0:6658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df69f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa6ea017771df69fa expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.108986:0:6658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df69f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa6ea017771df69fa expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351152.109064:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626378368:0@lo:501: 00000100:00100000:2.0:1789351152.109089:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351152.109109:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b41b3375 going to sleep for 11 seconds 00000100:00100000:0.0:1789351152.109133:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626378368 00000100:00100000:0.0:1789351152.109137:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626378368 00000100:00100000:0.0:1789351152.109191:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789351152.109201:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d66045fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+8:6658:x1876270626378368:12345-0@lo:501: 00000100:00100000:0.0:1789351152.109340:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d66045fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+8:6658:x1876270626378368:12345-0@lo:501: Request processed in 138us (250us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789351152.109347:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789351152.109384:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626378368:0@lo:501: 10000000:01000000:2.0:1789351152.109402:0:6658:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789351152.109427:0:6658:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789351152.109432:0:6658:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df69f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa6ea017771df69fa expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.109440:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df69f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa6ea017771df69fa expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.109446:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df69f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa6ea017771df69fa expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.109491:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789351152.109492:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351152.109497:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df69f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa6ea017771df69fa expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.109505:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a582372 already unused, calling callback (00000000010997cd) 10000000:00010000:3.0:1789351152.109507:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df69f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa6ea017771df69fa expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351152.109509:0:6658:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2cf76fd000 10000000:01000000:2.0:1789351152.109513:0:6658:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789351152.109514:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df69f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xa6ea017771df69fa expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351152.109516:0:6658:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d2cd83919c0 10000000:01000000:2.0:1789351152.109519:0:6658:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:00010000:3.0:1789351152.109521:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df69f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xa6ea017771df69fa expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351152.109521:0:6658:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8d2cd83919c0 from 1 10000000:01000000:2.0:1789351152.109524:0:6658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 10000000:01000000:3.0:1789351152.109526:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789351152.109536:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000321dcd4f/0xa6ea017771df6a01 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.109539:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df69f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa6ea017771df69fa expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.109542:0:6658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000321dcd4f/0xa6ea017771df6a01 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.109545:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789351152.109548:0:6658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000321dcd4f/0xa6ea017771df6a01 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351152.109558:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626378496:0@lo:101: 00010000:00010000:3.0:1789351152.109571:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df69f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa6ea017771df69fa expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.109578:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: 000000004a582372/0xa6ea017771df69f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa6ea017771df69fa expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351152.109583:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789351152.109601:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351152.109603:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351152.109604:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351152.109639:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789351152.109649:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000003d25421 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626378624:0@lo:103: 00000100:00100000:0.0:1789351152.109677:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351152.109705:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626378496 00000100:00100000:1.0:1789351152.109715:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626378496 00000100:00100000:1.0:1789351152.109739:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789351152.109745:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e1b91d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+8:6658:x1876270626378496:12345-0@lo:101: 00010000:00010000:1.0:1789351152.109752:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351152.109760:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005008d456/0xa6ea017771df6a08 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6a01 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.109775:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005008d456/0xa6ea017771df6a08 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6a01 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.109782:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005008d456/0xa6ea017771df6a08 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6a01 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.109788:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005008d456, rc 0) 00000100:00100000:1.0:1789351152.109825:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e1b91d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+9:6658:x1876270626378496:12345-0@lo:101: Request processed in 68us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351152.109831:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789351152.109932:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set 000000003a3ddef6 going to sleep for 11 seconds 00000100:00100000:2.0:1789351152.109947:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626378496:0@lo:101: 00010000:00010000:2.0:1789351152.109955:0:6658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000321dcd4f/0xa6ea017771df6a01 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a08 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.109962:0:6658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000321dcd4f/0xa6ea017771df6a01 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6a08 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351152.109975:0:6658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789351152.109991:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000321dcd4f/0xa6ea017771df6a01 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a08 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.109999:0:6658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000321dcd4f/0xa6ea017771df6a01 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a08 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351152.110005:0:6658:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789351152.110009:0:6658:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789351152.110012:0:6658:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789351152.110014:0:6658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789351152.110026:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000a9b2f1f4/0xa6ea017771df6a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.110032:0:6658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000a9b2f1f4/0xa6ea017771df6a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.110038:0:6658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000a9b2f1f4/0xa6ea017771df6a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351152.110048:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626378752:0@lo:101: 00000100:00100000:2.0:1789351152.110072:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351152.110093:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set 000000003a3ddef6 going to sleep for 11 seconds 00000100:00100000:0.0:1789351152.110897:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626378752 00000100:00100000:0.0:1789351152.110904:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626378752 00000100:00100000:0.0:1789351152.110939:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789351152.110946:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc48e86a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+9:6658:x1876270626378752:12345-0@lo:101: 00010000:00010000:0.0:1789351152.110955:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351152.110964:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001bf80d25/0xa6ea017771df6a16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6a0f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.110978:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001bf80d25/0xa6ea017771df6a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6a0f expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.110986:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001bf80d25/0xa6ea017771df6a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6a0f expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.110992:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001bf80d25, rc 0) 00000100:00100000:0.0:1789351152.111032:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc48e86a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+10:6658:x1876270626378752:12345-0@lo:101: Request processed in 87us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.111038:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789351152.111159:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626378752:0@lo:101: 00010000:00010000:2.0:1789351152.111170:0:6658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000a9b2f1f4/0xa6ea017771df6a0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a16 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.111179:0:6658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000a9b2f1f4/0xa6ea017771df6a0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6a16 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351152.111250:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626378880:0@lo:501: 00000100:00100000:2.0:1789351152.111276:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351152.111340:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set 000000003a3ddef6 going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.111418:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626378624 00000100:00100000:3.0:1789351152.111423:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626378624 00000100:00100000:3.0:1789351152.111460:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789351152.111466:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7fadd66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+10:3288:x1876270626378624:12345-0@lo:103: 00010000:00010000:3.0:1789351152.111475:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351152.111485:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000084c4e4b8/0xa6ea017771df69fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6ea017771df69f3 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.111496:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351152.111524:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7fadd66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+9:3288:x1876270626378624:12345-0@lo:103: Request processed in 59us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.111530:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351152.111549:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000003d25421 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626378624:0@lo:103: 00000100:00100000:1.0:1789351152.111719:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626378880 00000100:00100000:1.0:1789351152.111724:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626378880 00000100:00100000:1.0:1789351152.111745:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789351152.111759:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb3ca640 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+9:6658:x1876270626378880:12345-0@lo:501: 00000100:00100000:1.0:1789351152.111979:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb3ca640 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+9:6658:x1876270626378880:12345-0@lo:501: Request processed in 221us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351152.111984:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789351152.112027:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626378880:0@lo:501: 00000100:00100000:2.0:1789351152.112045:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626379008:0@lo:503: 00000100:00100000:2.0:1789351152.112079:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351152.112133:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set 000000003a3ddef6 going to sleep for 11 seconds 00000100:00100000:1.0:1789351152.112161:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626379008 00000100:00100000:1.0:1789351152.112164:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626379008 00000100:00100000:1.0:1789351152.112183:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789351152.112188:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3605c8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+9:6658:x1876270626379008:12345-0@lo:503: 00000100:00100000:1.0:1789351152.112341:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3605c8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+9:6658:x1876270626379008:12345-0@lo:503: Request processed in 152us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351152.112345:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789351152.112471:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626379008:0@lo:503: 00000040:00080000:2.0:1789351152.112750:0:6658:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789351152.112802:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626379136:0@lo:502: 00000100:00100000:2.0:1789351152.112838:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351152.112884:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set 000000003a3ddef6 going to sleep for 11 seconds 00000100:00100000:1.0:1789351152.112913:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626379136 00000100:00100000:1.0:1789351152.112916:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626379136 00000100:00100000:1.0:1789351152.112936:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789351152.112941:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091d36df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+9:6658:x1876270626379136:12345-0@lo:502: 00000100:00100000:1.0:1789351152.113080:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091d36df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+9:6658:x1876270626379136:12345-0@lo:502: Request processed in 139us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351152.113087:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789351152.113137:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626379136:0@lo:502: 00000040:00080000:2.0:1789351152.113301:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789351152.113330:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789351152.113347:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789351152.113409:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789351152.113438:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789351152.113455:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789351152.113474:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626379264:0@lo:502: 00000100:00100000:2.0:1789351152.113497:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351152.113547:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set 000000003a3ddef6 going to sleep for 11 seconds 00000100:00100000:1.0:1789351152.113574:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626379264 00000100:00100000:1.0:1789351152.113577:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626379264 00000100:00100000:1.0:1789351152.113597:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789351152.113611:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000247b4c2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+9:6658:x1876270626379264:12345-0@lo:502: 00000100:00100000:1.0:1789351152.113831:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000247b4c2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+9:6658:x1876270626379264:12345-0@lo:502: Request processed in 220us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351152.113843:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789351152.113852:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000787ff9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626379264:0@lo:502: 00000040:00080000:2.0:1789351152.113913:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789351152.113919:0:6658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1789351152.114277:0:6678:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789351152.114284:0:6678:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789351152.114294:0:6678:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351152.114297:0:6678:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789351152.114302:0:6678:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789351152.114319:0:6678:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000b74328ef) 00000020:00000080:1.0:1789351152.114333:0:6678:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789351152.114337:0:6678:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789351152.114422:0:6678:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000404e9f3a from lustre-OST0000, refs=2 00080000:01000000:1.0:1789351152.114431:0:6678:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789351152.114438:0:6678:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa6ea017771df6a24 00010000:00010000:1.0:1789351152.118193:0:6678:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1789351152.118501:0:6678:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789351152.121982:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789351152.122302:0:6678:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789351152.130329:0:6678:0:(osd_index.c:2105:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789351152.131537:0:6678:0:(osd_index.c:2105:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789351152.133857:0:6678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789351152.133870:0:6678:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351152.133876:0:6678:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351152.133879:0:6678:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789351152.133882:0:6678:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789351152.133885:0:6678:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351152.133887:0:6678:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789351152.133889:0:6678:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789351152.133891:0:6678:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789351152.133945:0:6678:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351152.133949:0:6678:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351152.133950:0:6678:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789351152.133953:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789351152.134092:0:6658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789351152.134116:0:6658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789351152.134157:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: 00000000a9b2f1f4/0xa6ea017771df6a0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a16 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.134170:0:6658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: 00000000a9b2f1f4/0xa6ea017771df6a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a16 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351152.134178:0:6658:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2cf76fd000 from 1 10000000:01000000:0.0:1789351152.134181:0:6658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789351152.134216:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6a2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.134224:0:6658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6a2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.134234:0:6658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6a2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351152.134255:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e6e9858d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626379392:0@lo:101: 00000100:00100000:0.0:1789351152.134316:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351152.134393:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set 0000000012d66cad going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.134456:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626379392 00000100:00100000:3.0:1789351152.134467:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626379392 00000100:00100000:3.0:1789351152.134512:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789351152.134520:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9ee6109 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+9:6658:x1876270626379392:12345-0@lo:101: 00010000:00010000:3.0:1789351152.134534:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351152.134546:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000693ed126/0xa6ea017771df6a32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6a2b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.134568:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000693ed126/0xa6ea017771df6a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6a2b expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.134578:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000693ed126/0xa6ea017771df6a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6a2b expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.134585:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000693ed126, rc 0) 00000100:00100000:3.0:1789351152.134633:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9ee6109 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:6658:x1876270626379392:12345-0@lo:101: Request processed in 113us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.134639:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789351152.134771:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e6e9858d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626379392:0@lo:101: 00010000:00010000:0.0:1789351152.134784:0:6658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6a2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a32 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.134793:0:6658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: 00000000ed5c54d3/0xa6ea017771df6a2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6a32 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351152.134886:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e6e9858d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626379520:0@lo:501: 00000100:00100000:0.0:1789351152.134911:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351152.134944:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set 0000000012d66cad going to sleep for 11 seconds 00000100:00100000:0.0:1789351152.134961:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626379520 00000100:00100000:0.0:1789351152.134965:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626379520 00000100:00100000:0.0:1789351152.134989:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789351152.134994:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5d4ee7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:6658:x1876270626379520:12345-0@lo:501: 00000100:00100000:0.0:1789351152.135204:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5d4ee7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:6658:x1876270626379520:12345-0@lo:501: Request processed in 209us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.135211:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789351152.135245:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e6e9858d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626379520:0@lo:501: 00000100:00100000:0.0:1789351152.135270:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e6e9858d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626379648:0@lo:503: 00000100:00100000:0.0:1789351152.135305:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351152.135318:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set 0000000012d66cad going to sleep for 11 seconds 00000100:00100000:0.0:1789351152.135331:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626379648 00000100:00100000:0.0:1789351152.135335:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626379648 00000100:00100000:0.0:1789351152.135352:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789351152.135383:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d82b417f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:6658:x1876270626379648:12345-0@lo:503: 00000100:00100000:0.0:1789351152.135513:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d82b417f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:6658:x1876270626379648:12345-0@lo:503: Request processed in 132us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.135520:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789351152.135564:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e6e9858d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626379648:0@lo:503: 00000040:00080000:0.0:1789351152.135802:0:6658:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789351152.135866:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e6e9858d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626379776:0@lo:502: 00000100:00100000:0.0:1789351152.135898:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351152.135911:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set 0000000012d66cad going to sleep for 11 seconds 00000100:00100000:0.0:1789351152.135924:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626379776 00000100:00100000:0.0:1789351152.135928:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626379776 00000100:00100000:0.0:1789351152.135945:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789351152.135955:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052e2e720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:6658:x1876270626379776:12345-0@lo:502: 00000100:00100000:0.0:1789351152.136061:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052e2e720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:6658:x1876270626379776:12345-0@lo:502: Request processed in 107us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.136069:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789351152.136103:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e6e9858d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626379776:0@lo:502: 00000040:00080000:0.0:1789351152.136792:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789351152.136861:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789351152.136884:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e6e9858d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626379904:0@lo:502: 00000100:00100000:0.0:1789351152.136919:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351152.136987:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set 0000000012d66cad going to sleep for 11 seconds 00000100:00100000:0.0:1789351152.137012:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626379904 00000100:00100000:0.0:1789351152.137017:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626379904 00000100:00100000:1.0:1789351152.137059:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789351152.137069:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e8007cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:6658:x1876270626379904:12345-0@lo:502: 00000100:00100000:1.0:1789351152.137531:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e8007cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:6658:x1876270626379904:12345-0@lo:502: Request processed in 465us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351152.137539:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789351152.137636:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e6e9858d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626379904:0@lo:502: 00000040:00080000:0.0:1789351152.137728:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789351152.137737:0:6658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789351152.138254:0:6682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789351152.138263:0:6682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351152.138265:0:6682:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789351152.138270:0:6682:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2cf76fd000 00000020:00000080:3.0:1789351152.138272:0:6682:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789351152.138438:0:6682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351152.138443:0:6682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351152.138444:0:6682:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789351152.138447:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789351152.138681:0:6658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789351152.138703:0:6658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789351152.138756:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030e00/0xa6ea017771df6a2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a32 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.138767:0:6658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030e00/0xa6ea017771df6a2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a32 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351152.138806:0:6658:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789351152.138809:0:6658:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2cf76fd000 10000000:01000000:1.0:1789351152.138829:0:6658:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2cf76fd000 10000000:01000000:1.0:1789351152.138834:0:6658:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789351152.138839:0:6658:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d2cf76fd000 from 1 10000000:01000000:1.0:1789351152.138842:0:6658:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789351152.138870:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.138879:0:6658:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.138889:0:6658:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351152.138905:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626380032:0@lo:101: 00000100:00100000:1.0:1789351152.138948:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351152.138983:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2c40000 going to sleep for 11 seconds 00000100:00100000:0.0:1789351152.139150:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626380032 00000100:00100000:0.0:1789351152.139155:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626380032 00000100:00100000:0.0:1789351152.139185:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789351152.139192:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:6658:x1876270626380032:12345-0@lo:101: 00010000:00010000:0.0:1789351152.139202:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351152.139213:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cc0031a00/0xa6ea017771df6a40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6a39 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.139233:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cc0031a00/0xa6ea017771df6a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6a39 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.139242:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cc0031a00/0xa6ea017771df6a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6a39 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.139261:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0031a00, rc 0) 00000100:00100000:0.0:1789351152.139293:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+11:6658:x1876270626380032:12345-0@lo:101: Request processed in 101us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.139299:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789351152.141441:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626380032:0@lo:101: 00010000:00010000:2.0:1789351152.141463:0:6658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6a39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a40 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.141475:0:6658:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6a39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6a40 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351152.141588:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1623100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626380160:0@lo:501: 00000100:00100000:2.0:1789351152.141632:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351152.141662:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf7e04000 going to sleep for 11 seconds 00000100:00100000:0.0:1789351152.141859:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626380160 00000100:00100000:0.0:1789351152.141865:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626380160 00000100:00100000:0.0:1789351152.141937:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789351152.141946:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:6658:x1876270626380160:12345-0@lo:501: 00000100:00100000:0.0:1789351152.142215:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:6658:x1876270626380160:12345-0@lo:501: Request processed in 269us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.142223:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789351152.142288:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1623100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626380160:0@lo:501: 00000100:00100000:1.0:1789351152.142320:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626380288:0@lo:503: 00000100:00100000:1.0:1789351152.142449:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351152.142465:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626380288 00000100:00100000:2.0:1789351152.142470:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626380288 00000100:00100000:1.0:1789351152.142470:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2c409c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789351152.142579:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789351152.142595:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:6658:x1876270626380288:12345-0@lo:503: 00000100:00100000:0.0:1789351152.142732:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:6658:x1876270626380288:12345-0@lo:503: Request processed in 145us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.142739:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789351152.142760:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626380288:0@lo:503: 00000040:00080000:1.0:1789351152.142995:0:6658:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789351152.143058:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626380416:0@lo:502: 00000100:00100000:1.0:1789351152.143090:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351152.143117:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2c409c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789351152.143211:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626380416 00000100:00100000:0.0:1789351152.143215:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626380416 00000100:00100000:0.0:1789351152.143237:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789351152.143244:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+11:6658:x1876270626380416:12345-0@lo:502: 00000100:00100000:0.0:1789351152.143508:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+11:6658:x1876270626380416:12345-0@lo:502: Request processed in 263us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.143515:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789351152.143613:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626380416:0@lo:502: 00000040:00080000:1.0:1789351152.143806:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789351152.143860:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789351152.143887:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789351152.143912:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789351152.143932:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789351152.143955:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789351152.143972:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789351152.144000:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789351152.144050:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789351152.144088:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789351152.144124:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789351152.144174:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789351152.144196:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789351152.144213:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789351152.144236:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789351152.144253:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789351152.144269:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789351152.144306:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789351152.144325:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789351152.144342:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789351152.144494:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789351152.144533:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789351152.144569:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789351152.144618:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789351152.144649:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789351152.144668:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789351152.144693:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789351152.144712:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1789351152.144734:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626380544:0@lo:502: 00000100:00100000:1.0:1789351152.144771:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351152.144800:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2c409c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789351152.144807:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626380544 00000100:00100000:2.0:1789351152.144822:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626380544 00000100:00100000:2.0:1789351152.144892:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789351152.144899:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+11:6658:x1876270626380544:12345-0@lo:502: 00000100:00100000:2.0:1789351152.145036:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+11:6658:x1876270626380544:12345-0@lo:502: Request processed in 136us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351152.145044:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789351152.145062:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626380544:0@lo:502: 00000040:00080000:1.0:1789351152.145120:0:6658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789351152.145134:0:6658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789351152.145777:0:6683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789351152.145793:0:6683:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d2cfa7f8000) 00000020:00000080:0.0:1789351152.145856:0:6683:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789351152.145992:0:6683:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2cf76fd000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789351152.145996:0:6683:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2cf76fd000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789351152.145999:0:6683:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2cf76fd000 3 00010000:00080000:0.0:1789351152.146026:0:6683:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2bc13e7800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.152@tcp at head 00010000:00010000:0.0:1789351152.149700:0:6683:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1789351152.149826:0:6683:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789351152.149862:0:6683:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789351152.149876:0:6683:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa6ea017771df6a4e 00000100:00080000:0.0:1789351152.149887:0:6683:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789351152.149892:0:6683:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d2bc13e7800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789351152.149929:0:6683:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2cf95fc000 x1876270626380672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789351152.150028:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1876270626380672:0@lo:38: 00000100:00100000:1.0:1789351152.150105:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789351152.150170:0:6683:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789351152.150229:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626380800:0@lo:400: 00000100:00100000:0.0:1789351152.150258:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351152.150302:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626380672 00000100:00100000:0.0:1789351152.150309:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626380672 00000100:00100000:0.0:1789351152.150335:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626380800 00000100:00100000:0.0:1789351152.150338:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626380800 00000100:00100000:0.0:1789351152.150389:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351152.150398:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626380800:12345-0@lo:400: 00000100:00100000:0.0:1789351152.150449:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626380800:12345-0@lo:400: Request processed in 51us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.150456:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351152.150470:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789351152.150474:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1876270626380672:12345-0@lo:38: 00010000:00080000:0.0:1789351152.150494:0:5822:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 96 last 0 00000020:00000080:0.0:1789351152.150540:0:5822:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa6ea017771df6a55 00000004:00100000:0.0:1789351152.150556:0:5822:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789351152.150588:0:5822:0:(import.c:65:import_set_state_nolock()) ffff8d2bc13e2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789351152.150766:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876270626380672:12345-0@lo:38: Request processed in 290us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.150773:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789351152.150835:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2cf95fed80 x1876270626380800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351152.150850:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626380800:0@lo:400: 00000040:00080000:0.0:1789351152.151184:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1789351152.151619:0:6658:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789351152.151644:0:6658:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789351152.151669:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6a39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a40 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.151679:0:6658:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a40 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789351152.151720:0:6658:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789351152.151722:0:6658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789351152.151723:0:6658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789351152.151725:0:6658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789351152.151726:0:6658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789351152.151728:0:6658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789351152.151729:0:6658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789351152.151730:0:6658:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789351152.151732:0:6658:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789351152.151733:0:6658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789351152.151735:0:6658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789351152.151738:0:6658:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789351152.151741:0:6658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789351152.151745:0:6658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789351152.151747:0:6658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789351152.151748:0:6658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789351152.151749:0:6658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789351152.151750:0:6658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789351152.151751:0:6658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789351152.151752:0:6658:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789351152.151753:0:6658:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789351152.151753:0:6658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789351152.151754:0:6658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789351152.151769:0:6658:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789351152.151781:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626380928:0@lo:253: 00000100:00100000:0.0:1789351152.151835:0:6658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351152.151867:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626380928 00000100:00100000:0.0:1789351152.151871:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626380928 00000100:00100000:0.0:1789351152.151901:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789351152.151908:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+11:6658:x1876270626380928:12345-0@lo:253: 20000000:01000000:0.0:1789351152.151936:0:5816:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789351152.151948:0:5816:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789351152.152342:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0788300 going to sleep for 11 seconds 00010000:00080000:1.0:1789351152.152723:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2cf95fc000 x1876270626380672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789351162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351152.152733:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789351152.152741:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789351152.152749:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789351152.152753:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789351152.152755:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2bc13e7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789351152.152761:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1876270626380672:0@lo:38: 20000000:01000000:0.0:1789351152.179053:0:5816:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789351152.179071:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789351152.179213:0:5838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789351152.179218:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789351152.179242:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2cf0f78a00/0xa6ea017771df6a5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.179272:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cf0f78a00/0xa6ea017771df6a5c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789351152.179283:0:5838:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001227379s 00010000:00010000:2.0:1789351152.179288:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2cf0f78a00/0xa6ea017771df6a5c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.179296:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2cf0f78a00/0xa6ea017771df6a5c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.179304:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2cf0f78a00/0xa6ea017771df6a5c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.179311:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2cf0f78a00/0xa6ea017771df6a5c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.179317:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f78a00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351152.179321:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2cf0f78a00/0xa6ea017771df6a5c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.179330:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2cf0f78a00/0xa6ea017771df6a5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.179344:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2cf0f78a00/0xa6ea017771df6a5c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.179353:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2cf0f78a00/0xa6ea017771df6a5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.179386:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cf0f78a00/0xa6ea017771df6a5c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351152.184511:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+11:6658:x1876270626380928:12345-0@lo:253: Request processed in 32595us (32666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.184523:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789351152.184625:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:6658:1876270626380928:0@lo:253: 10000000:01000000:1.0:1789351152.184638:0:6658:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789351152.184640:0:6658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789351152.184642:0:6658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789351152.184643:0:6658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789351152.184643:0:6658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789351152.184644:0:6658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789351152.184645:0:6658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789351152.184646:0:6658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789351152.184647:0:6658:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789351152.184648:0:6658:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789351152.184649:0:6658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789351152.184649:0:6658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789351152.184663:0:6658:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789351152.190585:0:6658:0:(osd_index.c:2105:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789351152.191160:0:6658:0:(osd_index.c:2105:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789351152.191426:0:6658:0:(osd_index.c:2105:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789351152.191628:0:6658:0:(osd_index.c:2105:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789351152.191918:0:6658:0:(osd_index.c:2105:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789351152.192236:0:6658:0:(osd_index.c:2105:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789351152.193315:0:6658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:2.0:1789351152.281422:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789351152.281430:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d2cc5fed000 from 21 10000000:01000000:2.0:1789351152.281435:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789351152.281479:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78a00/0xa6ea017771df6a63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.281493:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78a00/0xa6ea017771df6a63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.281505:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78a00/0xa6ea017771df6a63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351152.281529:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1621c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626381056:0@lo:101: 00000100:00100000:2.0:1789351152.281599:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351152.281656:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2eca000 going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.281854:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626381056 00000100:00100000:3.0:1789351152.281864:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626381056 00000100:00100000:3.0:1789351152.281914:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789351152.281925:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+11:5820:x1876270626381056:12345-0@lo:101: 00010000:00010000:3.0:1789351152.281948:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351152.281961:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6a6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6a63 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.281989:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6a63 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.282001:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6a63 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.282011:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c4000, rc 0) 00000100:00100000:3.0:1789351152.282058:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5820:x1876270626381056:12345-0@lo:101: Request processed in 134us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.282065:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789351152.282113:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1621c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626381056:0@lo:101: 00010000:00010000:3.0:1789351152.282126:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78a00/0xa6ea017771df6a63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a6a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.282138:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78a00/0xa6ea017771df6a63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6a6a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351152.282192:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626381184:0@lo:501: 00000100:00100000:3.0:1789351152.282222:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351152.282238:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc8a57300 going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.282263:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626381184 00000100:00100000:3.0:1789351152.282267:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626381184 00000100:00100000:3.0:1789351152.282293:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789351152.282300:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5820:x1876270626381184:12345-0@lo:501: 00000100:00100000:3.0:1789351152.283687:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5820:x1876270626381184:12345-0@lo:501: Request processed in 1383us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.283697:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789351152.284022:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626381184:0@lo:501: 00000100:00100000:3.0:1789351152.284060:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626381312:0@lo:503: 00000100:00100000:3.0:1789351152.284103:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351152.284127:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc8a57300 going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.284143:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626381312 00000100:00100000:3.0:1789351152.284149:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626381312 00000100:00100000:3.0:1789351152.284181:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789351152.284189:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5820:x1876270626381312:12345-0@lo:503: 00000100:00100000:3.0:1789351152.284449:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5820:x1876270626381312:12345-0@lo:503: Request processed in 260us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.284456:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789351152.284501:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626381312:0@lo:503: 00000100:00100000:3.0:1789351152.292226:0:6687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:6687:1876270626381440:0@lo:502: 00000100:00100000:3.0:1789351152.292320:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351152.292382:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626381440 00000100:00100000:0.0:1789351152.292390:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626381440 00000100:00100000:3.0:1789351152.292949:0:6687:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc8bb4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789351152.293136:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789351152.293145:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+12:6687:x1876270626381440:12345-0@lo:502: 00000100:00100000:0.0:1789351152.293383:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+12:6687:x1876270626381440:12345-0@lo:502: Request processed in 239us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.293389:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789351152.293462:0:6687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:6687:1876270626381440:0@lo:502: 00000100:00100000:3.0:1789351152.293531:0:6687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:6687:1876270626381568:0@lo:502: 00000100:00100000:3.0:1789351152.293573:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351152.293610:0:6687:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd001ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789351152.293848:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626381568 00000100:00100000:0.0:1789351152.293855:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626381568 00000100:00100000:0.0:1789351152.293881:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789351152.293886:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+12:6687:x1876270626381568:12345-0@lo:502: 00000100:00100000:0.0:1789351152.293979:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+12:6687:x1876270626381568:12345-0@lo:502: Request processed in 92us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.293983:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789351152.294690:0:6687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:6687:1876270626381568:0@lo:502: 00000040:00080000:3.0:1789351152.294717:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789351152.295426:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789351152.295444:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789351152.295453:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78a00/0xa6ea017771df6a63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a6a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.295462:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78a00/0xa6ea017771df6a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a6a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351152.295469:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789351152.295470:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d2cc5fed000 from 3 10000000:01000000:0.0:1789351152.295472:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789351152.295497:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031600/0xa6ea017771df6a71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.295503:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031600/0xa6ea017771df6a71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.295510:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031600/0xa6ea017771df6a71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351152.295522:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626381696:0@lo:101: 00000100:00100000:0.0:1789351152.295560:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351152.295617:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0788300 going to sleep for 11 seconds 00000100:00100000:1.0:1789351152.296978:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626381696 00000100:00100000:1.0:1789351152.296990:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626381696 00000100:00100000:0.0:1789351152.297173:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789351152.297183:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5820:x1876270626381696:12345-0@lo:101: 00010000:00010000:0.0:1789351152.297199:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351152.297215:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cc0031c00/0xa6ea017771df6a78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6a71 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.297240:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cc0031c00/0xa6ea017771df6a78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6a71 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.297251:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cc0031c00/0xa6ea017771df6a78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6a71 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.297261:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0031c00, rc 0) 00000100:00100000:0.0:1789351152.297319:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+13:5820:x1876270626381696:12345-0@lo:101: Request processed in 137us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.297325:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789351152.297339:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626381696:0@lo:101: 00010000:00010000:1.0:1789351152.297354:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031600/0xa6ea017771df6a71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a78 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.299570:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031600/0xa6ea017771df6a71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6a78 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351152.299923:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626381824:0@lo:256: 00000100:00100000:0.0:1789351152.299995:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351152.300036:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0788300 going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.303189:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626381824 00000100:00100000:3.0:1789351152.303203:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626381824 00000100:00100000:3.0:1789351152.303259:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789351152.303271:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:5820:x1876270626381824:12345-0@lo:256: 20000000:01000000:3.0:1789351152.303296:0:5814:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789351152.303448:0:5814:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789351152.303454:0:5814:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1789351152.303457:0:5814:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 4 00000100:00100000:3.0:1789351152.304601:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:5820:x1876270626381824:12345-0@lo:256: Request processed in 1329us (4603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.304614:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789351152.304677:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626381824:0@lo:256: 10000000:01000000:3.0:1789351152.304733:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789351152.304744:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031600/0xa6ea017771df6a71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a78 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.304756:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031600/0xa6ea017771df6a71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a78 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351152.304766:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789351152.304769:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789351152.304773:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789351152.304806:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6a7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.304828:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6a7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.304839:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6a7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351152.304868:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626381952:0@lo:101: 00000100:00100000:3.0:1789351152.304903:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351152.304937:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd001bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.304954:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626381952 00000100:00100000:3.0:1789351152.304959:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626381952 00000100:00100000:3.0:1789351152.304992:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789351152.305002:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+13:5820:x1876270626381952:12345-0@lo:101: 00010000:00010000:3.0:1789351152.305014:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351152.305027:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df6a86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6a7f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.305050:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df6a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6a7f expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.305062:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df6a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6a7f expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.305072:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c4a00, rc 0) 00000100:00100000:3.0:1789351152.305103:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626381952:12345-0@lo:101: Request processed in 104us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.305110:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789351152.305143:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626381952:0@lo:101: 00010000:00010000:3.0:1789351152.305157:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6a7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.305166:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6a7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6a86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351152.305224:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626382080:0@lo:501: 00000100:00100000:3.0:1789351152.305247:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351152.305262:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd001bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.305274:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626382080 00000100:00100000:3.0:1789351152.305277:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626382080 00000100:00100000:3.0:1789351152.305300:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789351152.305308:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626382080:12345-0@lo:501: 00000100:00100000:3.0:1789351152.306190:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626382080:12345-0@lo:501: Request processed in 881us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.306200:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789351152.306244:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626382080:0@lo:501: 00000100:00100000:3.0:1789351152.306328:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626382208:0@lo:503: 00000100:00100000:3.0:1789351152.309635:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351152.309687:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd001bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.309712:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626382208 00000100:00100000:3.0:1789351152.309720:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626382208 00000100:00100000:3.0:1789351152.309774:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789351152.309783:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626382208:12345-0@lo:503: 00000100:00100000:3.0:1789351152.313438:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626382208:12345-0@lo:503: Request processed in 3646us (3802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.313453:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789351152.313601:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626382208:0@lo:503: 00000100:00100000:3.0:1789351152.314724:0:6688:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:6688:1876270626382336:0@lo:502: 00000100:00100000:3.0:1789351152.314791:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351152.314851:0:6688:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd001bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.314871:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626382336 00000100:00100000:3.0:1789351152.314877:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626382336 00000100:00100000:3.0:1789351152.314919:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789351152.315214:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:6688:x1876270626382336:12345-0@lo:502: 00000100:00100000:3.0:1789351152.317263:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:6688:x1876270626382336:12345-0@lo:502: Request processed in 2327us (2464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.317275:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789351152.317456:0:6688:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:6688:1876270626382336:0@lo:502: 00000020:01000000:3.0:1789351152.317630:0:6688:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789351152.317639:0:6688:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789351152.317646:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351152.317649:0:6688:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789351152.317655:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789351152.317660:0:6688:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:3.0:1789351152.317685:0:6688:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789351152.317689:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789351152.317704:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d2ce9de99c0) 00000020:00000080:3.0:1789351152.317726:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789351152.317733:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789351152.317850:0:6688:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789351152.317855:0:6688:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789351152.317863:0:6688:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6ea017771df6a94 00010000:00080000:3.0:1789351152.317892:0:6688:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2cffa6e000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1789351152.318258:0:6688:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00002000:00080000:1.0:1789351152.346619:0:6658:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789351152.346626:0:6658:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789351152.346657:0:6658:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789351152.346716:0:6658:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789351152.346731:0:6658:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789351152.346756:0:6658:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:01000000:3.0:1789351152.351875:0:6688:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789351152.351897:0:6688:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789351152.352608:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789351152.354294:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789351152.354354:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789351152.354441:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789351152.358102:0:6690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789351152.358110:0:6690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789351152.358830:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789351152.358843:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789351152.358873:0:6688:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789351152.358895:0:6688:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6ea017771df6a9b 00000100:00080000:3.0:1789351152.358906:0:6688:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789351152.358912:0:6688:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d2cffa6e000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789351152.358947:0:6688:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2cf772d180 x1876270626382464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789351152.359007:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626382464:0@lo:8: 00000100:00100000:1.0:1789351152.359150:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789351152.359214:0:6688:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789351152.359286:0:6688:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351152.359291:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351152.359293:0:6688:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789351152.359296:0:6688:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789351152.359301:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351152.359302:0:6688:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789351152.359305:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789351152.359307:0:6688:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789351152.359332:0:6688:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:6688:1876270626382592:0@lo:502: 00000100:00100000:3.0:1789351152.359396:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351152.359416:0:6688:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf697f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.359436:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626382592 00000100:00100000:3.0:1789351152.359443:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626382592 00000100:00100000:3.0:1789351152.359479:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789351152.359488:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+14:6688:x1876270626382592:12345-0@lo:502: 00000100:00100000:3.0:1789351152.359887:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+14:6688:x1876270626382592:12345-0@lo:502: Request processed in 399us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.359894:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789351152.359951:0:6688:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:6688:1876270626382592:0@lo:502: 00000020:01000000:3.0:1789351152.359980:0:6688:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351152.359984:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351152.359986:0:6688:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789351152.359989:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1789351152.360157:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789351152.360173:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789351152.360183:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6a7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.360193:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6a86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351152.360203:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789351152.360205:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2cc5fed000 from 1 10000000:01000000:3.0:1789351152.360208:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789351152.360231:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5800/0xa6ea017771df6aa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.360239:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5800/0xa6ea017771df6aa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.360250:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5800/0xa6ea017771df6aa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351152.360274:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626382720:0@lo:101: 00000100:00100000:3.0:1789351152.360300:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351152.360320:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf697f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.360334:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626382720 00000100:00100000:3.0:1789351152.360337:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626382720 00000100:00100000:3.0:1789351152.360374:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789351152.360380:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626382720:12345-0@lo:101: 00010000:00010000:3.0:1789351152.360394:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351152.360406:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d021c5e00/0xa6ea017771df6aa9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6aa2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.360428:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d021c5e00/0xa6ea017771df6aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6aa2 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.360438:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d021c5e00/0xa6ea017771df6aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6aa2 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.360447:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c5e00, rc 0) 00000100:00100000:3.0:1789351152.360475:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626382720:12345-0@lo:101: Request processed in 94us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.360481:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789351152.360507:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626382720:0@lo:101: 00010000:00010000:3.0:1789351152.360518:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5800/0xa6ea017771df6aa2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6aa9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351152.360526:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5800/0xa6ea017771df6aa2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6aa9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351152.360562:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626382848:0@lo:501: 00000100:00100000:3.0:1789351152.360584:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351152.360600:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf697f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.360611:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626382848 00000100:00100000:3.0:1789351152.360614:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626382848 00000100:00100000:3.0:1789351152.360631:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789351152.360636:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626382848:12345-0@lo:501: 00000100:00100000:3.0:1789351152.360919:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626382848:12345-0@lo:501: Request processed in 281us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.360926:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789351152.361226:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626382848:0@lo:501: 00000100:00100000:3.0:1789351152.361256:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626382976:0@lo:503: 00000100:00100000:3.0:1789351152.361290:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351152.361316:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf697f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.361331:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626382976 00000100:00100000:3.0:1789351152.361335:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626382976 00000100:00100000:3.0:1789351152.361372:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789351152.361380:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626382976:12345-0@lo:503: 00000100:00100000:3.0:1789351152.361664:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626382976:12345-0@lo:503: Request processed in 285us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351152.361671:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789351152.361769:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626382464 00000100:00100000:1.0:1789351152.361774:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626382464 00000100:00100000:1.0:1789351152.361797:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789351152.361802:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1876270626382464:12345-0@lo:8: 00010000:00080000:1.0:1789351152.361834:0:6660:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 96 last 0 00000020:00000080:1.0:1789351152.361863:0:6660:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6ea017771df6ab0 00000100:00100000:2.0:1789351152.361880:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626382976:0@lo:503: 00002000:00100000:1.0:1789351152.361898:0:6660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d2bc1914800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789351152.361903:0:6660:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1789351152.361911:0:6660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789351152.362005:0:6660:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789351152.362206:0:6660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789351152.362230:0:6660:0:(import.c:65:import_set_state_nolock()) ffff8d2bc1917800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789351152.362283:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1876270626382464:12345-0@lo:8: Request processed in 479us (3133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351152.362289:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789351152.362412:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8d2cf772d180 x1876270626382464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789351162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351152.362422:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789351152.362428:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789351152.362435:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789351152.362440:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789351152.362442:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2cffa6e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789351152.362452:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789351152.362456:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626382464:0@lo:8: 00000004:00080000:1.0:1789351152.362467:0:6690:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789351152.362550:0:6690:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 96808191618ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789351152.364612:0:6692:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:6692:1876270626383104:0@lo:502: 00000100:00100000:0.0:1789351152.364682:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351152.364716:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626383104 00000100:00100000:0.0:1789351152.364721:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626383104 00000100:00100000:0.0:1789351152.364758:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789351152.364767:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+15:6692:x1876270626383104:12345-0@lo:502: 00000100:00100000:0.0:1789351152.367147:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+15:6692:x1876270626383104:12345-0@lo:502: Request processed in 2375us (2458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.367160:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789351152.367242:0:6692:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2eca0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789351152.367269:0:6692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:6692:1876270626383104:0@lo:502: 00000020:01000000:0.0:1789351152.367544:0:6692:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789351152.367554:0:6692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789351152.367556:0:6692:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789351152.367562:0:6692:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2cc5fed000 00000020:00000080:0.0:1789351152.367564:0:6692:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789351152.367601:0:6692:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:6692:1876270626383232:0@lo:502: 00000100:00100000:0.0:1789351152.367647:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351152.367675:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626383232 00000100:00100000:0.0:1789351152.367680:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626383232 00000100:00100000:0.0:1789351152.367712:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789351152.367720:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+15:6692:x1876270626383232:12345-0@lo:502: 00000100:00100000:0.0:1789351152.368758:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+15:6692:x1876270626383232:12345-0@lo:502: Request processed in 1035us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.368767:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789351152.368820:0:6692:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2eca0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789351152.368840:0:6692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:6692:1876270626383232:0@lo:502: 00000020:01000000:0.0:1789351152.368863:0:6692:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789351152.368869:0:6692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789351152.368871:0:6692:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789351152.368874:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789351152.368937:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789351152.368956:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789351152.368968:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5800/0xa6ea017771df6aa2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6aa9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.368979:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5800/0xa6ea017771df6aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6aa9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351152.368994:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789351152.368997:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2cd83919c0 from 1 10000000:01000000:0.0:1789351152.368999:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789351152.369028:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.369037:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351152.369046:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351152.369679:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626383360:0@lo:101: 00000100:00100000:0.0:1789351152.369715:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351152.369739:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf9d92900 going to sleep for 11 seconds 00000100:00100000:2.0:1789351152.369870:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626383360 00000100:00100000:2.0:1789351152.369877:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626383360 00000100:00100000:2.0:1789351152.369917:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789351152.369925:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626383360:12345-0@lo:101: 00010000:00010000:2.0:1789351152.369936:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351152.369948:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6abe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6ab7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.369971:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6ab7 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.369981:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6ab7 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351152.369990:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cf0f78000, rc 0) 00000100:00100000:2.0:1789351152.370023:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626383360:12345-0@lo:101: Request processed in 98us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351152.370029:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789351152.370728:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626383360:0@lo:101: 00010000:00010000:1.0:1789351152.370744:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6ab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6abe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.370754:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6ab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6abe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351152.370832:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626383488:0@lo:501: 00000100:00100000:1.0:1789351152.370865:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351152.370896:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc503a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.371184:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626383488 00000100:00100000:3.0:1789351152.371190:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626383488 00000100:00100000:3.0:1789351152.371221:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789351152.371233:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626383488:12345-0@lo:501: 00000100:00100000:3.0:1789351152.371392:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626383488:12345-0@lo:501: Request processed in 163us (526us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789351152.371399:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789351152.371403:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626383488:0@lo:501: 10000000:01000000:1.0:1789351152.371426:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789351152.371432:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6ab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6abe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351152.371440:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6abe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789351152.390779:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789351152.390940:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626383616:0@lo:13: 00000100:00100000:2.0:1789351152.391017:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351152.391086:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626383616 00000100:00100000:0.0:1789351152.391094:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626383616 00000004:00080000:1.0:1789351152.391106:0:6691:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789351152.391135:0:6691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6691:1876270626383744:0@lo:7: 00000100:00100000:0.0:1789351152.391144:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351152.391153:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1876270626383616:12345-0@lo:13: 00000100:00100000:1.0:1789351152.391162:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789351152.391173:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:1.0:1789351152.391184:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626383744 00000100:00100000:1.0:1789351152.391187:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626383744 00000100:00100000:1.0:1789351152.391211:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789351152.391218:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6691:x1876270626383744:12345-0@lo:7: 00000100:00100000:0.0:1789351152.392591:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1876270626383616:12345-0@lo:13: Request processed in 1435us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.392601:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789351152.392628:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789351152.392899:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8d2cc6f64380 x1876270626383616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351152.393084:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626383616:0@lo:13: 00000100:00100000:2.0:1789351152.393626:0:6691:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc503a840 going to sleep for 11 seconds 00002000:00080000:1.0:1789351152.395225:0:6663:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789351152.395230:0:6663:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789351152.395309:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6691:x1876270626383744:12345-0@lo:7: Request processed in 4089us (4144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351152.395316:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789351152.395414:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8d2cc6f64000 x1876270626383744/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789351168 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351152.395428:0:6691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6691:1876270626383744:0@lo:7: 00000004:00080000:2.0:1789351152.395439:0:6691:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789351152.395473:0:6691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1620a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6691:1876270626383872:0@lo:5: 00000100:00100000:2.0:1789351152.395508:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351152.395536:0:6691:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd029b540 going to sleep for 11 seconds 00000100:00100000:1.0:1789351152.395587:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626383872 00000100:00100000:1.0:1789351152.395593:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626383872 00000100:00100000:1.0:1789351152.395630:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789351152.395639:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6691:x1876270626383872:12345-0@lo:5: 00002000:00080000:1.0:1789351152.395660:0:6660:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789351152.395664:0:6660:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789351152.395830:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6691:x1876270626383872:12345-0@lo:5: Request processed in 191us (321us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789351152.395837:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789351152.395854:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8d2cd1620a80 x1876270626383872/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789351168 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351152.395866:0:6691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1620a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6691:1876270626383872:0@lo:5: 00000004:00080000:3.0:1789351152.395874:0:6691:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789351152.395903:0:6691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6691:1876270626384000:0@lo:700: 00000100:00100000:3.0:1789351152.395931:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351152.395957:0:6691:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf697fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789351152.396147:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626384000 00000100:00100000:2.0:1789351152.396151:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626384000 00000100:00100000:2.0:1789351152.396175:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789351152.396180:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6691:x1876270626384000:12345-0@lo:700: 00000100:00100000:2.0:1789351152.396201:0:6669:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1622a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6669:1876270626384128:0@lo:700: 00000100:00100000:2.0:1789351152.396223:0:6669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351152.396242:0:6669:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd029b000 going to sleep for 11 seconds 00000100:00100000:3.0:1789351152.396263:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626384128 00000100:00100000:3.0:1789351152.396268:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626384128 00000100:00100000:3.0:1789351152.396316:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789351152.396324:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6669:x1876270626384128:12345-0@lo:700: 00000100:00080000:0.0:1789351152.396939:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 40000000:02000000:0.0:1789351152.418459:0:5829:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1789351152.422658:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6669:x1876270626384128:12345-0@lo:700: Request processed in 26329us (26426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351152.422684:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789351152.422770:0:6669:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2cd1622a00 x1876270626384128/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789351168 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351152.422787:0:6669:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1622a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6669:1876270626384128:0@lo:700: 40000000:02000000:3.0:1789351152.422800:0:6669:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1789351152.478667:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789351152.478686:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789351152.478927:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6691:x1876270626384000:12345-0@lo:700: Request processed in 82741us (82990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351152.478940:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789351152.480492:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8d2cf772f800 x1876270626384000/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789351168 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351152.480506:0:6691:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789351152.480522:0:6691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6691:1876270626384000:0@lo:700: 00000004:02000040:3.0:1789351152.502840:0:6691:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1789351152.507538:0:6691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6691:1876270626384256:0@lo:5: 00000100:00100000:3.0:1789351152.507610:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351152.507653:0:6691:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf697fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789351152.507705:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626384256 00000100:00100000:1.0:1789351152.507713:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626384256 00000100:00100000:1.0:1789351152.507772:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789351152.507782:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6691:x1876270626384256:12345-0@lo:5: 00002000:00080000:1.0:1789351152.512804:0:6663:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789351152.512838:0:6663:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1789351152.516328:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6691:x1876270626384256:12345-0@lo:5: Request processed in 8541us (8711us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789351152.516345:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789351152.516506:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8d2cf772f800 x1876270626384256/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789351168 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351152.516535:0:6691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6691:1876270626384256:0@lo:5: 00000004:00080000:1.0:1789351152.516550:0:6691:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1789351152.609475:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351153.636528:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351154.660016:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789351155.378458:0:7032:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789351155.682638:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351156.705525:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351157.410424:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876270626384640:0@lo:400: 00000100:00100000:1.0:1789351157.410489:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351157.410539:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789351157.410545:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626384768:0@lo:400: 00000100:00100000:1.0:1789351157.410566:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351157.410604:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626384768 00000100:00100000:1.0:1789351157.410611:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626384768 00000100:00100000:1.0:1789351157.410655:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789351157.410664:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1876270626384768:12345-0@lo:400: 00000100:00100000:1.0:1789351157.410707:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1876270626384768:12345-0@lo:400: Request processed in 44us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351157.410714:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789351157.410764:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2cc6f64700 x1876270626384768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351157.410779:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626384768:0@lo:400: 00000100:00100000:3.0:1789351157.410849:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876270626384512:0@lo:400: 00000100:00100000:3.0:1789351157.410876:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351157.410909:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789351157.410915:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626384384:0@lo:400: 00000100:00100000:3.0:1789351157.410939:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351157.410966:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626384384 00000100:00100000:3.0:1789351157.410970:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626384384 00000100:00100000:3.0:1789351157.410994:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789351157.411001:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ce9d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+16:3289:x1876270626384384:12345-0@lo:400: 00000100:00100000:3.0:1789351157.411030:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ce9d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+16:3289:x1876270626384384:12345-0@lo:400: Request processed in 29us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351157.411036:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789351157.411069:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626384384:0@lo:400: 00000100:00100000:0.0:1789351157.411259:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626384640 00000100:00100000:0.0:1789351157.411264:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626384640 00000100:00100000:0.0:1789351157.411558:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626384512 00000100:00100000:0.0:1789351157.411563:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626384512 00000100:00100000:3.0:1789351157.411596:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789351157.411605:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876270626384640:12345-0@lo:400: 00000100:00100000:3.0:1789351157.411651:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876270626384640:12345-0@lo:400: Request processed in 48us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351157.411658:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789351157.411671:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789351157.411677:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876270626384512:12345-0@lo:400: 00000100:00100000:3.0:1789351157.411707:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876270626384512:12345-0@lo:400: Request processed in 31us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351157.411714:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789351157.411748:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2cc6f65500 x1876270626384512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351157.411758:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876270626384512:0@lo:400: 00010000:00080000:3.0:1789351157.411779:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2cc6f64a80 x1876270626384640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351157.411798:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876270626384640:0@lo:400: 00000100:00100000:3.0:1789351157.411918:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626384896:0@lo:13: 00000100:00100000:3.0:1789351157.411945:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789351157.412026:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789351157.412031:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789351157.412043:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626384896 00000100:00100000:0.0:1789351157.412047:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626384896 00000100:00100000:0.0:1789351157.412112:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789351157.412120:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626384896:12345-0@lo:13: 00002000:00000024:0.0:1789351157.412156:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789351157.412199:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626384896:12345-0@lo:13: Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351157.412206:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789351157.412249:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2cc6f64700 x1876270626384896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351157.412264:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626384896:0@lo:13: 00010000:00010000:3.0:1789351157.729525:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789351157.953281:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1789351158.753818:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351159.777493:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351160.801501:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351161.825720:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789351161.914792:0:7600:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789351161.914797:0:7600:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789351161.914932:0:7600:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8d2cc5aa8000 00000020:01000004:1.0:1789351161.914947:0:7600:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789351161.914959:0:7600:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789351161.914974:0:7600:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d2cffbdcd40) 00000020:00000080:1.0:1789351161.914991:0:7600:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789351161.924217:0:7600:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789351161.924399:0:7600:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789351161.940639:0:7600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789351161.943730:0:7600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789351161.943759:0:7600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789351161.943825:0:7600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789351161.943855:0:7600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789351161.944226:0:7600:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789351161.944238:0:7600:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789351161.944251:0:7600:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa6ea017771df6acc 00000020:01000004:3.0:1789351161.944259:0:7600:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789351161.944281:0:7600:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789351161.944284:0:7600:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789351161.944290:0:7600:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789351161.944312:0:7600:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789351161.944316:0:7600:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789351161.958487:0:7600:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789351161.958545:0:7600:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.152@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789351161.958549:0:7600:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789351161.958552:0:7600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789351161.958553:0:7600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789351161.958554:0:7600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789351161.958555:0:7600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789351161.958556:0:7600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789351161.958558:0:7600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789351161.958559:0:7600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789351161.958561:0:7600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789351161.958562:0:7600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789351161.958563:0:7600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789351161.958567:0:7600:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789351161.958570:0:7600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789351161.958571:0:7600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789351161.958572:0:7600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789351161.958574:0:7600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789351161.958575:0:7600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789351161.958576:0:7600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789351161.958577:0:7600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789351161.958578:0:7600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789351161.958579:0:7600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789351161.958580:0:7600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789351161.958581:0:7600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789351161.958607:0:7600:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789351161.958626:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626385024:0@lo:253: 00000100:00100000:3.0:1789351161.958706:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351161.958830:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda2836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789351161.958876:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626385024 00000100:00100000:0.0:1789351161.958884:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626385024 00000100:00100000:0.0:1789351161.959022:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789351161.959032:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ce9d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+16:7600:x1876270626385024:12345-0@lo:253: 20000000:01000000:0.0:1789351161.959069:0:5814:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789351161.959073:0:5814:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789351161.959078:0:5814:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789351161.959081:0:5814:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789351161.960240:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789351161.960458:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789351161.960479:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789351161.960521:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789351161.960529:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789351161.960563:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789351161.960616:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789351161.961054:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789351161.961074:0:5814:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.152@tcp 20000000:01000000:0.0:1789351161.961076:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:0.0:1789351161.961112:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789351161.961120:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789351161.961182:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789351161.961191:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:0.0:1789351161.961225:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789351161.961233:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789351161.961263:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789351161.961312:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789351161.962258:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1789351161.962277:0:5814:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.152@tcp 20000000:01000000:1.0:1789351161.962279:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.152@tcp (null) (null) (null) 00000040:00080000:1.0:1789351161.962315:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1789351161.962322:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789351161.962438:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1789351161.962448:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.152@tcp (null) (null) 00000040:00080000:1.0:1789351161.962480:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1789351161.962489:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789351161.962534:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1789351161.962570:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1789351161.962585:0:5814:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1789351161.962588:0:5814:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1789351161.962593:0:5814:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789351161.962595:0:5814:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789351161.962597:0:5814:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789351161.962608:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789351161.962611:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789351161.962643:0:5814:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789351161.962646:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789351161.963197:0:7601:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789351161.963244:0:7601:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789351161.963312:0:7601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789351161.963592:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1789351161.963633:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1789351161.963702:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1789351161.963715:0:5814:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789351161.963716:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789351161.968255:0:7602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789351161.968600:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789351161.968652:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789351161.968762:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1789351161.968776:0:5814:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789351161.968779:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789351161.969564:0:7603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1789351161.969615:0:7603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1789351161.969681:0:7603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789351161.969965:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789351161.970004:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789351161.970057:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789351161.970077:0:5814:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789351161.970080:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789351161.970703:0:7604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1789351161.970776:0:7604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1789351161.970808:0:7604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1789351161.971092:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1789351161.971132:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1789351161.971181:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:1.0:1789351161.971198:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789351161.971217:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2cd5931600/0xa6ea017771df6ad3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351161.971235:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6a0f expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351161.971242:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cc0031a00/0xa6ea017771df6a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6a39 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351161.971250:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6a63 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351161.971257:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df6a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6a7f expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351161.971264:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6abe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6ab7 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351161.971272:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2cd5931600/0xa6ea017771df6ad3 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351161.971311:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6ab7 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351161.971325:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6abe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6ab7 expref: 16 pid: 5816 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351161.971351:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f67480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5814:1876270626385152:0@lo:104: 00000100:00100000:1.0:1789351161.971557:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789351161.971639:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df6a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6a7f expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351161.971649:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df6a86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6a7f expref: 16 pid: 5816 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351161.971670:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5814:1876270626385280:0@lo:104: 00000100:00100000:1.0:1789351161.971694:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789351161.971854:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6a63 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351161.971862:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6a6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6a63 expref: 16 pid: 5814 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351161.971871:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5814:1876270626385408:0@lo:104: 00010000:00010000:1.0:1789351161.971906:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cc0031a00/0xa6ea017771df6a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6a39 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351161.971914:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2cc0031a00/0xa6ea017771df6a40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6a39 expref: 16 pid: 5814 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351161.971923:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f65500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5814:1876270626385536:0@lo:104: 00010000:00010000:1.0:1789351161.971965:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6a0f expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351161.971974:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6a16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6a0f expref: 16 pid: 5817 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351161.971989:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f65c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5814:1876270626385664:0@lo:104: 00000100:00100000:1.0:1789351161.972009:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce0326f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789351161.972105:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789351161.972123:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351161.972188:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351161.972208:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626385152 00000100:00100000:2.0:1789351161.972215:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626385152 00000100:00100000:2.0:1789351161.972247:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626385280 00000100:00100000:2.0:1789351161.972250:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626385280 00000100:00100000:2.0:1789351161.972259:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626385408 00000100:00100000:2.0:1789351161.972261:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626385408 00000100:00100000:2.0:1789351161.972272:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789351161.972281:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+5:5814:x1876270626385152:12345-0@lo:104: 00010000:00010000:2.0:1789351161.972293:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6abe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351161.972424:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789351161.972431:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+5:5814:x1876270626385152:12345-0@lo:104: Request processed in 151us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351161.972438:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789351161.972456:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789351161.972462:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6511450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+4:5814:x1876270626385280:12345-0@lo:104: 00010000:00010000:2.0:1789351161.972469:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6a86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351161.972501:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789351161.972506:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6511450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+4:5814:x1876270626385280:12345-0@lo:104: Request processed in 45us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351161.972511:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789351161.972546:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789351161.972552:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+3:5814:x1876270626385408:12345-0@lo:104: 00010000:00010000:2.0:1789351161.972558:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78a00/0xa6ea017771df6a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6a6a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351161.972583:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789351161.972588:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+3:5814:x1876270626385408:12345-0@lo:104: Request processed in 37us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351161.972593:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1789351161.972649:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789351161.972665:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6abe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.972674:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031200 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:0.0:1789351161.972678:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6abe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.972687:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6abe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789351161.972694:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6abe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351161.972699:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789351161.972744:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6ab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6abe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.972751:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789351161.972769:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6ab7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6abe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.972776:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6ab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6abe expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.972787:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789351161.972791:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6a86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.972797:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c4c00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:0.0:1789351161.972800:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6a86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.972807:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6a86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789351161.972814:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6a86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351161.972820:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789351161.972830:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6a7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.972836:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789351161.972849:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6a7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.972865:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6a7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.972876:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789351161.972879:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78a00/0xa6ea017771df6a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6a6a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.972885:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f78a00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:0.0:1789351161.972888:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78a00/0xa6ea017771df6a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6a6a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.972905:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78a00/0xa6ea017771df6a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6a6a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789351161.972912:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78a00/0xa6ea017771df6a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6a6a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351161.972918:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789351161.972931:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78a00/0xa6ea017771df6a63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a6a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.972937:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789351161.972942:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78a00/0xa6ea017771df6a63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a6a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.972949:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78a00/0xa6ea017771df6a63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a6a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.972957:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351161.972964:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351161.972966:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351161.972972:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351161.972985:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626385792:0@lo:103: 00000100:00100000:0.0:1789351161.973018:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351161.973061:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626385920:0@lo:103: 00000100:00100000:0.0:1789351161.973079:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351161.973095:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789351161.973099:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626386048:0@lo:103: 00000100:00100000:0.0:1789351161.973113:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351161.973136:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626385792 00000100:00100000:0.0:1789351161.973140:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626385792 00010000:00010000:0.0:1789351161.973157:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6abe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6ab7 expref: 17 pid: 5816 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351161.973174:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626385920 00000100:00100000:0.0:1789351161.973176:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626385920 00010000:00010000:0.0:1789351161.973185:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df6a86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6a7f expref: 18 pid: 5816 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351161.973194:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626386048 00000100:00100000:0.0:1789351161.973196:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626386048 00010000:00010000:0.0:1789351161.973205:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6a6a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6a63 expref: 19 pid: 5814 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351161.973216:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789351161.973221:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc312d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3289:x1876270626385792:12345-0@lo:103: 00010000:00010000:0.0:1789351161.973232:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351161.973236:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6abe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6ab7 expref: 19 pid: 5816 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.973252:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6abe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6ab7 expref: 19 pid: 5816 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.973268:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351161.973296:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc312d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3289:x1876270626385792:12345-0@lo:103: Request processed in 73us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351161.973302:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789351161.973333:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789351161.973339:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:3286:x1876270626385920:12345-0@lo:103: 00010000:00010000:0.0:1789351161.973346:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351161.973351:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df6a86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6a7f expref: 18 pid: 5816 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.973381:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df6a86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6a7f expref: 18 pid: 5816 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.973392:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351161.973415:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:3286:x1876270626385920:12345-0@lo:103: Request processed in 76us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351161.973421:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789351161.973431:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789351161.973437:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+17:3286:x1876270626386048:12345-0@lo:103: 00010000:00010000:0.0:1789351161.973443:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351161.973447:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6a6a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6a63 expref: 17 pid: 5814 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.973455:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6a6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6a63 expref: 17 pid: 5814 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.973470:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351161.973490:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+17:3286:x1876270626386048:12345-0@lo:103: Request processed in 54us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351161.973497:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789351161.973546:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626386048:0@lo:103: 00000100:00100000:0.0:1789351161.973555:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626385920:0@lo:103: 00000100:00100000:0.0:1789351161.973649:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626385792:0@lo:103: 00000100:00100000:3.0:1789351161.973834:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351161.973845:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626385536 00000100:00100000:3.0:1789351161.973849:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626385536 00000100:00100000:3.0:1789351161.973867:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626385664 00000100:00100000:3.0:1789351161.973869:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626385664 00000100:00100000:3.0:1789351161.973881:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789351161.973887:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+4:5814:x1876270626385536:12345-0@lo:104: 00010000:00010000:3.0:1789351161.973906:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6a40 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351161.973941:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789351161.973946:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+4:5814:x1876270626385536:12345-0@lo:104: Request processed in 60us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351161.973952:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789351161.973965:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789351161.973972:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+3:5814:x1876270626385664:12345-0@lo:104: 00010000:00010000:3.0:1789351161.973978:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78e00/0xa6ea017771df6a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6a16 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351161.974006:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789351161.974011:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+3:5814:x1876270626385664:12345-0@lo:104: Request processed in 41us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351161.974016:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789351161.974157:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789351161.974163:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6a40 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974170:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cd5931400 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:0.0:1789351161.974174:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6a40 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974182:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6a40 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789351161.974189:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6a40 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351161.974194:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789351161.974222:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6a39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a40 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974229:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789351161.974250:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6a39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a40 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974264:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6a39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a40 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974274:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789351161.974277:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78e00/0xa6ea017771df6a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6a16 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974282:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f78e00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:0.0:1789351161.974285:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78e00/0xa6ea017771df6a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6a16 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974292:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78e00/0xa6ea017771df6a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6a16 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789351161.974298:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78e00/0xa6ea017771df6a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6a16 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351161.974303:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789351161.974317:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78e00/0xa6ea017771df6a0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a16 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974323:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789351161.974328:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78e00/0xa6ea017771df6a0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a16 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974334:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78e00/0xa6ea017771df6a0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a16 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974344:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351161.974351:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351161.974353:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351161.974388:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626386304:0@lo:103: 00000100:00100000:0.0:1789351161.974414:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351161.974438:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789351161.974444:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626386176:0@lo:103: 00000100:00100000:0.0:1789351161.974463:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351161.974485:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626386304 00000100:00100000:0.0:1789351161.974488:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626386304 00010000:00010000:0.0:1789351161.974504:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6a16 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6a0f expref: 17 pid: 5817 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351161.974520:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626386176 00000100:00100000:0.0:1789351161.974523:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626386176 00010000:00010000:0.0:1789351161.974532:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cc0031a00/0xa6ea017771df6a40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6a39 expref: 18 pid: 5814 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351161.974544:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789351161.974551:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7166352-9951-4386-a0b0-6dc1f552d00a+18:3289:x1876270626386304:12345-0@lo:103: 00010000:00010000:0.0:1789351161.974560:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351161.974564:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6a16 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6a0f expref: 18 pid: 5817 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974573:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6a16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6a0f expref: 18 pid: 5817 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974583:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351161.974609:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7166352-9951-4386-a0b0-6dc1f552d00a+18:3289:x1876270626386304:12345-0@lo:103: Request processed in 58us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351161.974615:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789351161.974634:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789351161.974640:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7166352-9951-4386-a0b0-6dc1f552d00a+17:3289:x1876270626386176:12345-0@lo:103: 00010000:00010000:0.0:1789351161.974647:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351161.974651:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cc0031a00/0xa6ea017771df6a40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6a39 expref: 17 pid: 5814 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974672:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cc0031a00/0xa6ea017771df6a40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6a39 expref: 17 pid: 5814 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974682:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2cd5931600/0xa6ea017771df6ad3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974690:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cd5931600/0xa6ea017771df6ad3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974703:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2cd5931600/0xa6ea017771df6ad3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974710:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2cd5931600/0xa6ea017771df6ad3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974716:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2cd5931600/0xa6ea017771df6ad3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974723:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2cd5931600/0xa6ea017771df6ad3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974728:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cd5931600 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351161.974733:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2cd5931600/0xa6ea017771df6ad3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974740:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2cd5931600/0xa6ea017771df6ad3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974755:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2cd5931600/0xa6ea017771df6ad3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351161.974764:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351161.974786:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7166352-9951-4386-a0b0-6dc1f552d00a+17:3289:x1876270626386176:12345-0@lo:103: Request processed in 147us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351161.974793:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789351161.974819:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626386176:0@lo:103: 00000100:00100000:0.0:1789351161.974827:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626386304:0@lo:103: 00010000:00010000:0.0:1789351161.974842:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351161.975097:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6abe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6ab7 expref: 16 pid: 5816 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351161.975109:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f67480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5814:1876270626385152:0@lo:104: 00010000:00010000:1.0:1789351161.975121:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df6a86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6a7f expref: 15 pid: 5816 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351161.975129:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5814:1876270626385280:0@lo:104: 00010000:00010000:1.0:1789351161.975139:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6a6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6a63 expref: 14 pid: 5814 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351161.975149:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5814:1876270626385408:0@lo:104: 00010000:00010000:1.0:1789351161.975158:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cc0031a00/0xa6ea017771df6a40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6a39 expref: 13 pid: 5814 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351161.975166:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f65500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5814:1876270626385536:0@lo:104: 00010000:00010000:1.0:1789351161.975174:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6a16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6a0f expref: 12 pid: 5817 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351161.975182:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f65c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5814:1876270626385664:0@lo:104: 00010000:00010000:1.0:1789351161.975199:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2cd5931600/0xa6ea017771df6ad3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351161.975207:0:5814:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2cd5931600/0xa6ea017771df6ad3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351161.975219:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2cd5931600/0xa6ea017771df6ad3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351161.975225:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cd5931600/0xa6ea017771df6ad3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789351161.975237:0:5814:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789351162.004475:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ce9d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+11:7600:x1876270626385024:12345-0@lo:253: Request processed in 45435us (45759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351162.004501:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789351162.004613:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626385024:0@lo:253: 10000000:01000000:1.0:1789351162.004629:0:7600:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789351162.004633:0:7600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789351162.004635:0:7600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789351162.004636:0:7600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789351162.004637:0:7600:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1789351162.004639:0:7600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789351162.004640:0:7600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789351162.004642:0:7600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789351162.004643:0:7600:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789351162.004645:0:7600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789351162.004646:0:7600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789351162.004674:0:7600:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2cc5aa8000 from lustre-OST0001 10000000:01000000:1.0:1789351162.004701:0:7600:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789351162.004705:0:7600:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789351162.004712:0:7600:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2cd83919c0 local copy 10000000:01000000:1.0:1789351162.004717:0:7600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789351162.004753:0:7600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6ada lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351162.004764:0:7600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6ada lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351162.004775:0:7600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6ada lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351162.004806:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626386432:0@lo:101: 00000100:00100000:1.0:1789351162.004843:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351162.004892:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce0326000 going to sleep for 11 seconds 00000100:00100000:3.0:1789351162.004953:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626386432 00000100:00100000:3.0:1789351162.004959:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626386432 00000100:00100000:3.0:1789351162.004991:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789351162.005000:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ce9d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+11:7600:x1876270626386432:12345-0@lo:101: 00010000:00010000:3.0:1789351162.005013:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351162.005026:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d02045000/0xa6ea017771df6ae1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6ada expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.005051:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d02045000/0xa6ea017771df6ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6ada expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.005062:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d02045000/0xa6ea017771df6ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6ada expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.005071:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d02045000, rc 0) 00000100:00100000:3.0:1789351162.005108:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ce9d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+12:7600:x1876270626386432:12345-0@lo:101: Request processed in 109us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351162.005114:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789351162.005184:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626386432:0@lo:101: 00010000:00010000:1.0:1789351162.005195:0:7600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6ada lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa6ea017771df6ae1 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351162.005204:0:7600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6ada lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa6ea017771df6ae1 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351162.005285:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626386560:0@lo:501: 00000100:00100000:1.0:1789351162.005308:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351162.005329:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce0326000 going to sleep for 11 seconds 00000100:00100000:3.0:1789351162.005377:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626386560 00000100:00100000:3.0:1789351162.005381:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626386560 00000100:00100000:3.0:1789351162.005410:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789351162.005416:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+12:7600:x1876270626386560:12345-0@lo:501: 00000100:00100000:3.0:1789351162.005589:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+12:7600:x1876270626386560:12345-0@lo:501: Request processed in 172us (278us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789351162.005596:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789351162.005625:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626386560:0@lo:501: 10000000:01000000:3.0:1789351162.005644:0:7600:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789351162.005680:0:7600:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789351162.005686:0:7600:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6ada lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa6ea017771df6ae1 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.005693:0:7600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6ada lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa6ea017771df6ae1 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.005701:0:7600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa6ea017771df6ae1 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.005715:0:7600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789351162.005730:0:7600:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2cc5aa8000 10000000:01000000:3.0:1789351162.005734:0:7600:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789351162.005738:0:7600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789351162.005740:0:7600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789351162.005744:0:7600:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789351162.005746:0:7600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789351162.005759:0:7600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d02045800/0xa6ea017771df6ae8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.005766:0:7600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d02045800/0xa6ea017771df6ae8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.005773:0:7600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d02045800/0xa6ea017771df6ae8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351162.005783:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626386688:0@lo:101: 00000100:00100000:3.0:1789351162.005807:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351162.005830:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda283c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789351162.005841:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626386688 00000100:00100000:3.0:1789351162.005844:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626386688 00000100:00100000:3.0:1789351162.005859:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789351162.005865:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+12:7600:x1876270626386688:12345-0@lo:101: 00010000:00010000:3.0:1789351162.005871:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351162.005878:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d02044400/0xa6ea017771df6aef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6ae8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.005891:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d02044400/0xa6ea017771df6aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6ae8 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.005900:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d02044400/0xa6ea017771df6aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6ae8 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.005906:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d02044400, rc 0) 00000100:00100000:3.0:1789351162.005932:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626386688:12345-0@lo:101: Request processed in 67us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351162.005938:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789351162.005966:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626386688:0@lo:101: 00010000:00010000:3.0:1789351162.005975:0:7600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d02045800/0xa6ea017771df6ae8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6aef expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.005981:0:7600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d02045800/0xa6ea017771df6ae8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6aef expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351162.006026:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626386816:0@lo:501: 00000100:00100000:3.0:1789351162.006048:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351162.006061:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda283c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789351162.006080:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626386816 00000100:00100000:3.0:1789351162.006083:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626386816 00000100:00100000:3.0:1789351162.006099:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789351162.006104:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8338050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626386816:12345-0@lo:501: 00000100:00100000:3.0:1789351162.006229:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8338050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626386816:12345-0@lo:501: Request processed in 124us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351162.006236:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789351162.006264:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626386816:0@lo:501: 00000100:00100000:3.0:1789351162.006285:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626386944:0@lo:503: 00000100:00100000:3.0:1789351162.006317:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351162.006330:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda283c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789351162.006340:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626386944 00000100:00100000:3.0:1789351162.006343:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626386944 00000100:00100000:3.0:1789351162.006386:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789351162.006393:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8339450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626386944:12345-0@lo:503: 00000100:00100000:3.0:1789351162.006519:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8339450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626386944:12345-0@lo:503: Request processed in 126us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351162.006526:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789351162.006560:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626386944:0@lo:503: 00000040:00080000:3.0:1789351162.006798:0:7600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789351162.006848:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626387072:0@lo:502: 00000100:00100000:3.0:1789351162.006879:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351162.006898:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda283c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789351162.006910:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626387072 00000100:00100000:3.0:1789351162.006914:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626387072 00000100:00100000:3.0:1789351162.006930:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789351162.006936:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626387072:12345-0@lo:502: 00000100:00100000:3.0:1789351162.007049:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626387072:12345-0@lo:502: Request processed in 113us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351162.007055:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789351162.007087:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626387072:0@lo:502: 00000040:00080000:3.0:1789351162.007323:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789351162.007391:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789351162.007430:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789351162.007480:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789351162.007517:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789351162.007552:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789351162.007574:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626387200:0@lo:502: 00000100:00100000:3.0:1789351162.007607:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351162.007628:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda283c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789351162.007640:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626387200 00000100:00100000:3.0:1789351162.007643:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626387200 00000100:00100000:3.0:1789351162.007673:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789351162.007679:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626387200:12345-0@lo:502: 00000100:00100000:3.0:1789351162.007788:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626387200:12345-0@lo:502: Request processed in 108us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351162.007795:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789351162.007829:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626387200:0@lo:502: 00000040:00080000:3.0:1789351162.007895:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789351162.007904:0:7600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00010000:00010000:0.0:1789351162.008223:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789351162.008232:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa6ea017771df6ae1 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.008242:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cd5931600 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:0.0:1789351162.008245:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa6ea017771df6ae1 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.008255:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa6ea017771df6ae1 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789351162.008262:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa6ea017771df6ae1 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351162.008268:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789351162.008288:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6ada lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa6ea017771df6ae1 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.008304:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789351162.008339:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6ada lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa6ea017771df6ae1 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.008347:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6ada lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa6ea017771df6ae1 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.008389:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351162.008391:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351162.008393:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351162.008450:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626387328:0@lo:103: 00000100:00100000:1.0:1789351162.008484:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351162.008559:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626387328 00000100:00100000:0.0:1789351162.008564:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626387328 00000100:00100000:0.0:1789351162.008603:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789351162.008611:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7166352-9951-4386-a0b0-6dc1f552d00a+13:3286:x1876270626387328:12345-0@lo:103: 00010000:00010000:0.0:1789351162.008622:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351162.008637:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d02045000/0xa6ea017771df6ae1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6ea017771df6ada expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.008648:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351162.008691:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7166352-9951-4386-a0b0-6dc1f552d00a+12:3286:x1876270626387328:12345-0@lo:103: Request processed in 80us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351162.008697:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789351162.008724:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626387328:0@lo:103: 00000020:01000000:2.0:1789351162.008983:0:7606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789351162.008991:0:7606:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789351162.008997:0:7606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351162.009000:0:7606:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789351162.009004:0:7606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789351162.009024:0:7606:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d2cc5f84d40) 00000020:00000080:2.0:1789351162.009052:0:7606:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789351162.009060:0:7606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789351162.009112:0:7606:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2cc5aa8000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789351162.009119:0:7606:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789351162.009124:0:7606:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa6ea017771df6afd 00010000:00010000:2.0:1789351162.012140:0:7606:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1789351162.012492:0:7606:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789351162.014764:0:7606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789351162.014981:0:7606:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789351162.018149:0:7606:0:(osd_index.c:2105:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789351162.019840:0:7606:0:(osd_index.c:2105:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789351162.023298:0:7606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789351162.023311:0:7606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351162.023318:0:7606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351162.023321:0:7606:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789351162.023331:0:7606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789351162.023335:0:7606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351162.023337:0:7606:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789351162.023340:0:7606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789351162.023342:0:7606:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789351162.023427:0:7606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351162.023432:0:7606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351162.023434:0:7606:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789351162.023438:0:7606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789351162.027533:0:7600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1789351162.027571:0:7600:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789351162.027590:0:7600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d02045800/0xa6ea017771df6ae8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6aef expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.027614:0:7600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d02045800/0xa6ea017771df6ae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6aef expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351162.027622:0:7600:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2cc5aa8000 from 1 10000000:01000000:0.0:1789351162.027625:0:7600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789351162.027670:0:7600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6b04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.027678:0:7600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6b04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.027689:0:7600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6b04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351162.027713:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626387456:0@lo:101: 00000100:00100000:0.0:1789351162.027781:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351162.029699:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6e13780 going to sleep for 11 seconds 00000100:00100000:3.0:1789351162.034050:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626387456 00000100:00100000:3.0:1789351162.034063:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626387456 00000100:00100000:3.0:1789351162.034127:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789351162.034136:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+12:7600:x1876270626387456:12345-0@lo:101: 00010000:00010000:3.0:1789351162.034152:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351162.034169:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d02044c00/0xa6ea017771df6b0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6b04 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.034196:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d02044c00/0xa6ea017771df6b0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6b04 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.034205:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d02044c00/0xa6ea017771df6b0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6b04 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.034214:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d02044c00, rc 0) 00000100:00100000:3.0:1789351162.034391:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626387456:12345-0@lo:101: Request processed in 255us (6608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351162.034398:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789351162.034529:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626387456:0@lo:101: 00010000:00010000:2.0:1789351162.034546:0:7600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6b04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6b0b expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351162.034556:0:7600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6b04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6b0b expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351162.034668:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626387584:0@lo:501: 00000100:00100000:2.0:1789351162.034700:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351162.034737:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc503a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789351162.034838:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626387584 00000100:00100000:3.0:1789351162.034843:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626387584 00000100:00100000:3.0:1789351162.034896:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789351162.034903:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626387584:12345-0@lo:501: 00000100:00100000:3.0:1789351162.035102:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626387584:12345-0@lo:501: Request processed in 200us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351162.035109:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789351162.035156:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626387584:0@lo:501: 00000100:00100000:2.0:1789351162.035178:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626387712:0@lo:503: 00000100:00100000:2.0:1789351162.035210:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351162.035342:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc503a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789351162.035484:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626387712 00000100:00100000:1.0:1789351162.035488:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626387712 00000100:00100000:1.0:1789351162.035507:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789351162.035513:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626387712:12345-0@lo:503: 00000100:00100000:1.0:1789351162.035785:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626387712:12345-0@lo:503: Request processed in 272us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351162.035792:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789351162.035851:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626387712:0@lo:503: 00000040:00080000:2.0:1789351162.036074:0:7600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789351162.036123:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626387840:0@lo:502: 00000100:00100000:2.0:1789351162.036151:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351162.036177:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd5cec240 going to sleep for 11 seconds 00000100:00100000:1.0:1789351162.036212:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626387840 00000100:00100000:1.0:1789351162.036215:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626387840 00000100:00100000:1.0:1789351162.036230:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789351162.036235:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626387840:12345-0@lo:502: 00000100:00100000:1.0:1789351162.036354:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626387840:12345-0@lo:502: Request processed in 118us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351162.036391:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789351162.036484:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626387840:0@lo:502: 00000040:00080000:2.0:1789351162.036702:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789351162.036742:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789351162.036759:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626387968:0@lo:502: 00000100:00100000:2.0:1789351162.036786:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351162.036810:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc503a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789351162.036843:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626387968 00000100:00100000:1.0:1789351162.036847:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626387968 00000100:00100000:1.0:1789351162.036862:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789351162.036867:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626387968:12345-0@lo:502: 00000100:00100000:1.0:1789351162.036962:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626387968:12345-0@lo:502: Request processed in 94us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351162.036968:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789351162.037021:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626387968:0@lo:502: 00000040:00080000:2.0:1789351162.037080:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789351162.037088:0:7600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789351162.037549:0:7610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789351162.037557:0:7610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351162.037560:0:7610:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789351162.037565:0:7610:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2cc5aa8000 00000020:00000080:2.0:1789351162.037567:0:7610:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789351162.037581:0:7610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789351162.037583:0:7610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351162.037585:0:7610:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789351162.037587:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789351162.037689:0:7600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789351162.037707:0:7600:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789351162.037727:0:7600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6b04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6b0b expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.037737:0:7600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6b04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6b0b expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351162.037775:0:7600:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789351162.037778:0:7600:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2cc5aa8000 10000000:01000000:3.0:1789351162.037782:0:7600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2cc5aa8000 10000000:01000000:3.0:1789351162.037785:0:7600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789351162.037790:0:7600:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d2cc5aa8000 from 1 10000000:01000000:3.0:1789351162.037793:0:7600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789351162.037814:0:7600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d02045e00/0xa6ea017771df6b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.037822:0:7600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d02045e00/0xa6ea017771df6b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.037831:0:7600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d02045e00/0xa6ea017771df6b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351162.037843:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626388096:0@lo:101: 00000100:00100000:3.0:1789351162.037874:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351162.037896:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda2836c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351162.037915:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626388096 00000100:00100000:3.0:1789351162.037919:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626388096 00000100:00100000:3.0:1789351162.037948:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789351162.037955:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8339c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626388096:12345-0@lo:101: 00010000:00010000:3.0:1789351162.037962:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351162.037973:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d02044000/0xa6ea017771df6b19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6b12 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.037990:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d02044000/0xa6ea017771df6b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6b12 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.037998:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d02044000/0xa6ea017771df6b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6b12 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.038006:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d02044000, rc 0) 00000100:00100000:3.0:1789351162.038033:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8339c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:7600:x1876270626388096:12345-0@lo:101: Request processed in 79us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351162.038038:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789351162.038070:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626388096:0@lo:101: 00010000:00010000:3.0:1789351162.038080:0:7600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d02045e00/0xa6ea017771df6b12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6b19 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.038087:0:7600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d02045e00/0xa6ea017771df6b12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6b19 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351162.038140:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626388224:0@lo:501: 00000100:00100000:3.0:1789351162.038160:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351162.038172:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda2836c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351162.038183:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626388224 00000100:00100000:3.0:1789351162.038192:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626388224 00000100:00100000:3.0:1789351162.038207:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789351162.038212:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8338c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:7600:x1876270626388224:12345-0@lo:501: 00000100:00100000:3.0:1789351162.039543:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8338c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:7600:x1876270626388224:12345-0@lo:501: Request processed in 1326us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351162.039553:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789351162.039652:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626388224:0@lo:501: 00000100:00100000:2.0:1789351162.039698:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626388352:0@lo:503: 00000100:00100000:2.0:1789351162.039741:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351162.039772:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda2836c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351162.039847:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626388352 00000100:00100000:3.0:1789351162.039853:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626388352 00000100:00100000:3.0:1789351162.039971:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789351162.039981:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+14:7600:x1876270626388352:12345-0@lo:503: 00000100:00100000:3.0:1789351162.040136:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+14:7600:x1876270626388352:12345-0@lo:503: Request processed in 157us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351162.040143:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789351162.040202:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626388352:0@lo:503: 00000040:00080000:2.0:1789351162.040501:0:7600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789351162.040556:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626388480:0@lo:502: 00000100:00100000:2.0:1789351162.040587:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351162.040839:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc503a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789351162.040892:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626388480 00000100:00100000:0.0:1789351162.040897:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626388480 00000100:00100000:0.0:1789351162.040918:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789351162.040924:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+14:7600:x1876270626388480:12345-0@lo:502: 00000100:00100000:0.0:1789351162.041099:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+14:7600:x1876270626388480:12345-0@lo:502: Request processed in 174us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351162.041105:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789351162.041171:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626388480:0@lo:502: 00000040:00080000:2.0:1789351162.041404:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789351162.041450:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789351162.041478:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789351162.041514:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789351162.041541:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789351162.041576:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789351162.041605:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789351162.041631:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789351162.041677:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789351162.041708:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789351162.041736:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789351162.041770:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789351162.041797:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789351162.041823:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789351162.041861:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789351162.041896:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789351162.041928:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789351162.041965:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789351162.041993:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789351162.042019:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789351162.042066:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789351162.042094:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789351162.042118:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789351162.042152:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789351162.042179:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789351162.042207:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789351162.042243:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789351162.042278:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789351162.042304:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789351162.042339:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789351162.042389:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789351162.042424:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789351162.042455:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789351162.042507:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789351162.042543:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789351162.042592:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789351162.042641:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789351162.042682:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626388608:0@lo:502: 00000100:00100000:2.0:1789351162.042732:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351162.042758:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda2836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789351162.042828:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626388608 00000100:00100000:0.0:1789351162.042833:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626388608 00000100:00100000:0.0:1789351162.042858:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789351162.042866:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+14:7600:x1876270626388608:12345-0@lo:502: 00000100:00100000:0.0:1789351162.043035:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+14:7600:x1876270626388608:12345-0@lo:502: Request processed in 169us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351162.043043:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789351162.043166:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1623800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626388608:0@lo:502: 00000040:00080000:2.0:1789351162.043226:0:7600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1789351162.043233:0:7600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789351162.043780:0:7611:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789351162.043803:0:7611:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d2bc1e60000) 00000020:00000080:2.0:1789351162.043824:0:7611:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1789351162.043982:0:7611:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2cc5aa8000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789351162.043986:0:7611:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2cc5aa8000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789351162.043989:0:7611:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2cc5aa8000 3 00010000:00080000:2.0:1789351162.044022:0:7611:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2bc1e68800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.152@tcp at head 00010000:00010000:2.0:1789351162.047276:0:7611:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1789351162.047350:0:7611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789351162.047413:0:7611:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789351162.047427:0:7611:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa6ea017771df6b27 00000100:00080000:2.0:1789351162.047438:0:7611:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789351162.047443:0:7611:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d2bc1e68800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789351162.047478:0:7611:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2cd1623800 x1876270626388736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789351162.047501:0:7611:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789351162.047594:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1876270626388736:0@lo:38: 00000100:00100000:1.0:1789351162.047674:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351162.047730:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626388736 00000100:00100000:1.0:1789351162.047736:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626388736 00000100:00100000:1.0:1789351162.047759:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789351162.047766:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1876270626388736:12345-0@lo:38: 00010000:00080000:1.0:1789351162.047787:0:5824:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 106 last 0 00000020:00000080:1.0:1789351162.047824:0:5824:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa6ea017771df6b2e 00000004:00100000:1.0:1789351162.047837:0:5824:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789351162.047864:0:5824:0:(import.c:65:import_set_state_nolock()) ffff8d2cffbd2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789351162.047912:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876270626388736:12345-0@lo:38: Request processed in 144us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351162.047918:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789351162.047951:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2cd1623800 x1876270626388736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789351172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351162.047961:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789351162.047974:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789351162.047981:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789351162.047985:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789351162.047987:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2bc1e68800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789351162.047993:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1876270626388736:0@lo:38: 00000100:00100000:3.0:1789351162.048068:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876270626388864:0@lo:400: 00000100:00100000:3.0:1789351162.048090:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351162.048149:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626388864 00000100:00100000:1.0:1789351162.048152:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626388864 00000100:00100000:1.0:1789351162.048212:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789351162.048220:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876270626388864:12345-0@lo:400: 00000100:00100000:1.0:1789351162.048255:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876270626388864:12345-0@lo:400: Request processed in 36us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351162.048261:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789351162.048313:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2cd1623480 x1876270626388864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351162.048323:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876270626388864:0@lo:400: 00000100:00100000:0.0:1789351162.048756:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626389120:0@lo:400: 00000100:00100000:0.0:1789351162.048797:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351162.048826:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789351162.048832:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876270626388992:0@lo:400: 00000100:00100000:0.0:1789351162.048856:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351162.048924:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626388992 00000100:00100000:1.0:1789351162.048928:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626388992 00000100:00100000:1.0:1789351162.048956:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789351162.048963:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876270626388992:12345-0@lo:400: 00000100:00080000:0.0:1789351162.048984:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789351162.048997:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876270626388992:12345-0@lo:400: Request processed in 35us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351162.049003:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789351162.049003:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2cd1621880 x1876270626388992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351162.049012:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876270626388992:0@lo:400: 00000100:00100000:3.0:1789351162.049961:0:7613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772f480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7613:1876270626389248:0@lo:901: 00000040:00080000:1.0:1789351162.050002:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1789351162.050022:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351162.050054:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626389248 00000100:00100000:0.0:1789351162.050060:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626389248 00000020:01000000:3.0:1789351162.050063:0:7600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789351162.050095:0:7600:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:0.0:1789351162.050099:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351162.050107:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7613:x1876270626389248:12345-0@lo:901: 00010000:00010000:3.0:1789351162.050116:0:7600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d02045e00/0xa6ea017771df6b12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6b19 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.050127:0:7600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d02045e00/0xa6ea017771df6b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6b19 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789351162.050178:0:7600:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789351162.050180:0:7600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789351162.050181:0:7600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789351162.050182:0:7600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789351162.050183:0:7600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789351162.050185:0:7600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789351162.050186:0:7600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789351162.050187:0:7600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789351162.050188:0:7600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789351162.050190:0:7600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789351162.050191:0:7600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789351162.050194:0:7600:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789351162.050197:0:7600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789351162.050198:0:7600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789351162.050199:0:7600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789351162.050212:0:7600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789351162.050214:0:7600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789351162.050215:0:7600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789351162.050216:0:7600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789351162.050218:0:7600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789351162.050219:0:7600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789351162.050221:0:7600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789351162.050222:0:7600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789351162.050237:0:7600:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789351162.050246:0:7600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626389376:0@lo:253: 00000100:00100000:3.0:1789351162.050287:0:7600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351162.050318:0:7600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cefd50900 going to sleep for 11 seconds 00000100:00100000:1.0:1789351162.050329:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626389376 00000100:00100000:1.0:1789351162.050334:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626389376 00000100:00100000:3.0:1789351162.050336:0:7613:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cefd506c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351162.050405:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789351162.050415:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+14:7600:x1876270626389376:12345-0@lo:253: 20000000:01000000:3.0:1789351162.050458:0:5817:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789351162.050471:0:5817:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789351162.050480:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7613:x1876270626389248:12345-0@lo:901: Request processed in 372us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351162.050489:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789351162.050508:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789351162.050904:0:7613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2cf772f480 x1876270626389248/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789351178 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351162.050929:0:7613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772f480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7613:1876270626389248:0@lo:901: 00000100:00100000:2.0:1789351162.050976:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626389120 00000100:00100000:2.0:1789351162.050982:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626389120 00000100:00100000:2.0:1789351162.051054:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789351162.051061:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626389120:12345-0@lo:400: 00000100:00100000:2.0:1789351162.051101:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626389120:12345-0@lo:400: Request processed in 41us (2304us total) trans 0 rc 0/0 00000100:00080000:0.0:1789351162.051105:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789351162.051107:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789351162.051736:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2cd1621f80 x1876270626389120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351162.051746:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789351162.051756:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626389120:0@lo:400: 20000000:01000000:3.0:1789351162.062390:0:5817:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789351162.062407:0:5817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789351162.062413:0:5838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789351162.062418:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789351162.062437:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6b35 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.062451:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cc0031c00/0xa6ea017771df6a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6a71 expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.062464:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6b35 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.062496:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cc0031c00/0xa6ea017771df6a78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6a71 expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.062506:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2cc0031c00/0xa6ea017771df6a78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6a71 expref: 14 pid: 5817 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351162.062519:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1876270626389504:0@lo:104: 00000100:00100000:0.0:1789351162.062572:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351162.062608:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6e139c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351162.062625:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626389504 00000100:00100000:3.0:1789351162.062633:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626389504 00000100:00100000:3.0:1789351162.062691:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789351162.062702:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+3:5838:x1876270626389504:12345-0@lo:104: 00000100:00100000:0.0:1789351162.062712:0:5805:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:3.0:1789351162.062715:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031600/0xa6ea017771df6a71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6a78 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351162.062719:0:5805:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1789351162.062782:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789351162.062789:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+3:5838:x1876270626389504:12345-0@lo:104: Request processed in 90us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351162.062797:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789351162.062823:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351162.062829:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031600/0xa6ea017771df6a71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6a78 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.062836:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031600 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:3.0:1789351162.062840:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031600/0xa6ea017771df6a71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6a78 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.062850:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031600/0xa6ea017771df6a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6a78 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789351162.062858:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031600/0xa6ea017771df6a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6a78 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351162.062875:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789351162.062906:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031600/0xa6ea017771df6a71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a78 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.062914:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789351162.062937:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031600/0xa6ea017771df6a71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a78 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.062945:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031600/0xa6ea017771df6a71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a78 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351162.062948:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626389632:0@lo:103: 00010000:00010000:3.0:1789351162.062966:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351162.062969:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351162.062972:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351162.062977:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351162.063005:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626389632 00000100:00100000:3.0:1789351162.063007:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1876270626389504:0@lo:104: 00000100:00100000:0.0:1789351162.063009:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626389632 00010000:00010000:0.0:1789351162.063026:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cc0031c00/0xa6ea017771df6a78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6a71 expref: 15 pid: 5817 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.063030:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6b35 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351162.063047:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789351162.063052:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+15:3286:x1876270626389632:12345-0@lo:103: 00010000:00010000:0.0:1789351162.063060:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351162.063064:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cc0031c00/0xa6ea017771df6a78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6a71 expref: 15 pid: 5817 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.063071:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cc0031c00/0xa6ea017771df6a78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6a71 expref: 15 pid: 5817 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.063091:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cc0031c00/0xa6ea017771df6a78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6a71 expref: 15 pid: 5817 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.063103:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6b35 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.063112:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6b35 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789351162.063125:0:5808:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001227379s 00010000:00010000:0.0:1789351162.063129:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6b35 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.063137:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6b35 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.063144:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6b35 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.063151:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6b35 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.063158:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351162.063163:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6b35 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.063171:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6b35 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.063195:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6b35 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351162.063215:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351162.063251:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:3286:x1876270626389632:12345-0@lo:103: Request processed in 197us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351162.063259:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789351162.063290:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626389632:0@lo:103: 00010000:00010000:3.0:1789351162.063324:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6b35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.063333:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6b35 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351162.063339:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cc0030c00/0xa6ea017771df6b35 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351162.075526:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+13:7600:x1876270626389376:12345-0@lo:253: Request processed in 25105us (25230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351162.075554:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789351162.075692:0:7600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f7166352-9951-4386-a0b0-6dc1f552d00a:7600:1876270626389376:0@lo:253: 10000000:01000000:0.0:1789351162.075707:0:7600:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789351162.075711:0:7600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789351162.075713:0:7600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789351162.075714:0:7600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789351162.075715:0:7600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789351162.075717:0:7600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789351162.075718:0:7600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789351162.075719:0:7600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789351162.075721:0:7600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789351162.075722:0:7600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789351162.075723:0:7600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789351162.075725:0:7600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789351162.075742:0:7600:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789351162.080110:0:7600:0:(osd_index.c:2105:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789351162.080292:0:7600:0:(osd_index.c:2105:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789351162.080519:0:7600:0:(osd_index.c:2105:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789351162.080731:0:7600:0:(osd_index.c:2105:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789351162.081050:0:7600:0:(osd_index.c:2105:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789351162.081293:0:7600:0:(osd_index.c:2105:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789351162.082550:0:7600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789351162.232676:0:7600:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789351162.232685:0:7600:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789351162.232715:0:7600:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789351162.232769:0:7600:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789351162.232799:0:7600:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789351162.232826:0:7600:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:0.0:1789351162.529510:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789351162.529783:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626389760:0@lo:13: 00000100:00100000:0.0:1789351162.529848:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351162.529965:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626389760 00000100:00100000:1.0:1789351162.529977:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626389760 00000100:00100000:1.0:1789351162.530053:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789351162.530064:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626389760:12345-0@lo:13: 00002000:00000024:1.0:1789351162.530097:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789351162.530145:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626389760:12345-0@lo:13: Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351162.530152:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789351162.530246:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2cc6f64700 x1876270626389760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351162.530264:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626389760:0@lo:13: 00010000:00010000:0.0:1789351162.851638:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351163.874848:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351164.900092:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789351164.985472:0:7954:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789351165.921745:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351166.945668:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351167.137568:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626389888:0@lo:400: 00000100:00100000:3.0:1789351167.137659:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351167.137837:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626389888 00000100:00100000:1.0:1789351167.137845:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626389888 00000100:00100000:1.0:1789351167.137892:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789351167.137901:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+13:3288:x1876270626389888:12345-0@lo:400: 00000100:00100000:2.0:1789351167.138121:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876270626390016:0@lo:400: 00000100:00100000:0.0:1789351167.138150:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876270626390144:0@lo:400: 00000100:00100000:2.0:1789351167.138165:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351167.138194:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789351167.138201:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876270626390400:0@lo:400: 00000100:00100000:2.0:1789351167.138228:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351167.138252:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626390272:0@lo:400: 00000100:00100000:2.0:1789351167.138275:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351167.138346:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351167.138413:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626390016 00000100:00100000:2.0:1789351167.138418:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626390016 00000100:00100000:2.0:1789351167.138442:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626390400 00000100:00100000:2.0:1789351167.138444:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626390400 00000100:00100000:2.0:1789351167.138470:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626390144 00000100:00100000:2.0:1789351167.138473:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626390144 00000100:00100000:2.0:1789351167.138488:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789351167.138493:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876270626390016:12345-0@lo:400: 00000100:00100000:2.0:1789351167.138530:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876270626390016:12345-0@lo:400: Request processed in 37us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351167.138536:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789351167.138562:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789351167.138568:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876270626390400:12345-0@lo:400: 00000100:00100000:2.0:1789351167.138605:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876270626390400:12345-0@lo:400: Request processed in 38us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351167.138611:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789351167.138620:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789351167.138625:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876270626390144:12345-0@lo:400: 00000100:00100000:2.0:1789351167.138650:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876270626390144:12345-0@lo:400: Request processed in 25us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351167.138655:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789351167.138683:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf95fed80 x1876270626390144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351167.138695:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876270626390144:0@lo:400: 00010000:00080000:2.0:1789351167.138718:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf95fc380 x1876270626390400/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351167.138727:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876270626390400:0@lo:400: 00010000:00080000:2.0:1789351167.138735:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf95fe680 x1876270626390016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351167.138742:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876270626390016:0@lo:400: 00000100:00080000:0.0:1789351167.138996:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789351167.143433:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626390272 00000100:00100000:0.0:1789351167.143448:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626390272 00000100:00100000:0.0:1789351167.143528:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789351167.143538:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626390272:12345-0@lo:400: 00000100:00080000:2.0:1789351167.143618:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789351167.143637:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626390272:12345-0@lo:400: Request processed in 100us (5360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351167.143644:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789351167.143662:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf95fc000 x1876270626390272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351167.143679:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626390272:0@lo:400: 00000100:00100000:1.0:1789351167.146830:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+13:3288:x1876270626389888:12345-0@lo:400: Request processed in 8921us (9162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351167.146844:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789351167.147099:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626389888:0@lo:400: 00000100:00100000:2.0:1789351167.650844:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626390528:0@lo:13: 00000100:00100000:2.0:1789351167.650949:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351167.651034:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626390528 00000100:00100000:0.0:1789351167.651042:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626390528 00000100:00100000:0.0:1789351167.651095:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789351167.651105:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626390528:12345-0@lo:13: 00002000:00000024:0.0:1789351167.651137:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789351167.651495:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626390528:12345-0@lo:13: Request processed in 390us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351167.651503:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789351167.651721:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc6f67480 x1876270626390528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351167.651741:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626390528:0@lo:13: 00010000:00010000:2.0:1789351167.970836:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351168.377397:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351168.377523:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616936576 00000100:00100000:0.0:1789351168.377541:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616936576 00000100:00100000:2.0:1789351168.377684:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:2.0:1789351168.377693:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2346:x1876270616936576:12345-192.168.201.52@tcp:250: 00010000:00080000:2.0:1789351168.377719:0:5814:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 038b9b38-b2ec-45ac-958b-dad437feb5c7@192.168.201.52@tcp t0 exp 0000000000000000 cur 112 last 0 00000020:00000080:2.0:1789351168.377746:0:5814:0:(genops.c:1406:class_connect()) connect: client 038b9b38-b2ec-45ac-958b-dad437feb5c7, cookie 0xa6ea017771df6b3c 00000100:00080000:2.0:1789351168.377855:0:5814:0:(import.c:65:import_set_state_nolock()) ffff8d2bc1e6c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789351168.377912:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+5:2346:x1876270616936576:12345-192.168.201.52@tcp:250: Request processed in 219us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351168.377920:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:2.0:1789351168.381411:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351168.381489:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616936704 00000100:00100000:1.0:1789351168.381498:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616936704 00000100:00100000:1.0:1789351168.381550:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00100000:1.0:1789351168.381569:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+5:5569:x1876270616936704:12345-192.168.201.52@tcp:101: 00010000:00010000:1.0:1789351168.381593:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351168.381610:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cd5931400/0xa6ea017771df6b43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7b53 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351168.381637:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cd5931400/0xa6ea017771df6b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b53 expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351168.381664:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cd5931400/0xa6ea017771df6b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b53 expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351168.381673:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cd5931400, rc 0) 00000100:00100000:1.0:1789351168.381727:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+6:5569:x1876270616936704:12345-192.168.201.52@tcp:101: Request processed in 169us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351168.381734:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00100000:2.0:1789351168.386801:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351168.387285:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616936832 00000100:00100000:1.0:1789351168.387294:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616936832 00000100:00100000:1.0:1789351168.387349:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:1.0:1789351168.387374:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+6:5569:x1876270616936832:12345-192.168.201.52@tcp:501: 00000100:00100000:1.0:1789351168.387701:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+6:5569:x1876270616936832:12345-192.168.201.52@tcp:501: Request processed in 342us (908us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789351168.387710:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:0.0:1789351168.390112:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351168.390177:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616936960 00000100:00100000:3.0:1789351168.390185:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616936960 00000100:00100000:3.0:1789351168.390235:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:3.0:1789351168.390245:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+6:5569:x1876270616936960:12345-192.168.201.52@tcp:101: 00010000:00010000:3.0:1789351168.390398:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351168.390416:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d02045a00/0xa6ea017771df6b4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7b5a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351168.390444:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d02045a00/0xa6ea017771df6b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b5a expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351168.390457:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d02045a00/0xa6ea017771df6b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b5a expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351168.390466:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d02045a00, rc 0) 00000100:00100000:3.0:1789351168.390511:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+7:5569:x1876270616936960:12345-192.168.201.52@tcp:101: Request processed in 268us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351168.390519:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:3.0:1789351168.391818:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351168.392010:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616937088 00000100:00100000:0.0:1789351168.392016:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616937088 00000100:00100000:0.0:1789351168.392045:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00100000:0.0:1789351168.392053:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+7:5569:x1876270616937088:12345-192.168.201.52@tcp:501: 00000100:00100000:0.0:1789351168.392264:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+8:5569:x1876270616937088:12345-192.168.201.52@tcp:501: Request processed in 210us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351168.392271:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00100000:2.0:1789351168.393812:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351168.393838:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616937216 00000100:00100000:2.0:1789351168.393844:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616937216 00000100:00100000:2.0:1789351168.393876:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:2.0:1789351168.393883:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+8:5569:x1876270616937216:12345-192.168.201.52@tcp:503: 00000100:00100000:2.0:1789351168.394162:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+8:5569:x1876270616937216:12345-192.168.201.52@tcp:503: Request processed in 278us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351168.394170:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:1.0:1789351168.404843:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351168.405316:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616937344 00000100:00100000:2.0:1789351168.405326:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616937344 00000100:00100000:2.0:1789351168.405407:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:2.0:1789351168.405415:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+8:5588:x1876270616937344:12345-192.168.201.52@tcp:502: 00000100:00100000:2.0:1789351168.405964:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+8:5588:x1876270616937344:12345-192.168.201.52@tcp:502: Request processed in 548us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351168.405973:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:0.0:1789351168.418726:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351168.418919:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616937472 00000100:00100000:1.0:1789351168.418929:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616937472 00000100:00100000:1.0:1789351168.418981:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:1.0:1789351168.418990:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+8:5588:x1876270616937472:12345-192.168.201.52@tcp:502: 00000100:00100000:1.0:1789351168.419232:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+8:5588:x1876270616937472:12345-192.168.201.52@tcp:502: Request processed in 242us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351168.419240:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:2.0:1789351168.424288:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351168.424322:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616937600 00000100:00100000:2.0:1789351168.424331:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616937600 00000100:00100000:2.0:1789351168.424389:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:2.0:1789351168.424399:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+8:5569:x1876270616937600:12345-192.168.201.52@tcp:101: 00010000:00010000:2.0:1789351168.424414:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351168.424432:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cf0f79200/0xa6ea017771df6b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7b84 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351168.424463:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cf0f79200/0xa6ea017771df6b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b84 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351168.424475:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cf0f79200/0xa6ea017771df6b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b84 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351168.424485:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cf0f79200, rc 0) 00000100:00100000:2.0:1789351168.424541:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:5569:x1876270616937600:12345-192.168.201.52@tcp:101: Request processed in 144us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351168.424548:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:0.0:1789351168.426782:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351168.426875:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616937728 00000100:00100000:1.0:1789351168.426883:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616937728 00000100:00100000:1.0:1789351168.426925:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:1.0:1789351168.426934:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:5569:x1876270616937728:12345-192.168.201.52@tcp:256: 20000000:01000000:1.0:1789351168.426961:0:5816:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789351168.426974:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789351168.426978:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789351168.426981:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789351168.426983:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789351168.429205:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:5569:x1876270616937728:12345-192.168.201.52@tcp:256: Request processed in 2264us (2423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351168.429218:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:2.0:1789351168.431865:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351168.432015:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616937856 00000100:00100000:0.0:1789351168.432024:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616937856 00000100:00100000:0.0:1789351168.432081:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:0.0:1789351168.432091:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:5569:x1876270616937856:12345-192.168.201.52@tcp:101: 00010000:00010000:0.0:1789351168.432109:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351168.432127:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cc0031400/0xa6ea017771df6b58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7b8b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351168.432155:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cc0031400/0xa6ea017771df6b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b8b expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351168.432168:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cc0031400/0xa6ea017771df6b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b8b expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351168.432197:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0031400, rc 0) 00000100:00100000:0.0:1789351168.432252:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5569:x1876270616937856:12345-192.168.201.52@tcp:101: Request processed in 162us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351168.432259:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:1.0:1789351168.433538:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351168.434108:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616937984 00000100:00100000:0.0:1789351168.434117:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616937984 00000100:00100000:0.0:1789351168.434615:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:0.0:1789351168.434625:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5569:x1876270616937984:12345-192.168.201.52@tcp:501: 00000100:00100000:0.0:1789351168.434845:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5569:x1876270616937984:12345-192.168.201.52@tcp:501: Request processed in 219us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351168.434852:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:2.0:1789351168.437536:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351168.437613:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616938112 00000100:00100000:3.0:1789351168.437631:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616938112 00000100:00100000:3.0:1789351168.437677:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00100000:3.0:1789351168.437686:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5569:x1876270616938112:12345-192.168.201.52@tcp:503: 00000100:00100000:3.0:1789351168.438031:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5569:x1876270616938112:12345-192.168.201.52@tcp:503: Request processed in 344us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351168.438040:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00100000:2.0:1789351168.440148:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351168.440331:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616938240 00000100:00100000:0.0:1789351168.440349:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616938240 00000100:00100000:0.0:1789351168.440414:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 95 00000100:00100000:0.0:1789351168.440424:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5592:x1876270616938240:12345-192.168.201.52@tcp:502: 00000100:00100000:0.0:1789351168.440645:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5592:x1876270616938240:12345-192.168.201.52@tcp:502: Request processed in 221us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351168.440653:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 95 00000100:00100000:0.0:1789351168.441781:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351168.441848:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616938368 00000100:00100000:3.0:1789351168.441853:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616938368 00000100:00100000:3.0:1789351168.441884:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:3.0:1789351168.441893:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5592:x1876270616938368:12345-192.168.201.52@tcp:502: 00000100:00100000:3.0:1789351168.442046:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5592:x1876270616938368:12345-192.168.201.52@tcp:502: Request processed in 154us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351168.442054:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:2.0:1789351168.443677:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351168.443714:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616938496 00000100:00100000:2.0:1789351168.443721:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616938496 00000100:00100000:2.0:1789351168.443750:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:2.0:1789351168.443757:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2346:x1876270616938496:12345-192.168.201.52@tcp:38: 00010000:00080000:2.0:1789351168.443783:0:5824:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp t0 exp 0000000000000000 cur 112 last 0 00000020:00000080:2.0:1789351168.443834:0:5824:0:(genops.c:1406:class_connect()) connect: client 8237986d-b9e8-417a-ac8f-a078390d268c, cookie 0xa6ea017771df6b5f 00000004:00100000:2.0:1789351168.443860:0:5824:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789351168.443866:0:5824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1789351168.458317:0:5824:0:(import.c:65:import_set_state_nolock()) ffff8d2bc1e69000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789351168.458423:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+6:2346:x1876270616938496:12345-192.168.201.52@tcp:38: Request processed in 14663us (14750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351168.458434:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00010000:00010000:1.0:1789351168.993694:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351169.460006:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351169.460096:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616938752 00000100:00100000:0.0:1789351169.460107:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616938752 00000100:00100000:0.0:1789351169.460185:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00080000:2.0:1789351169.460192:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789351169.460198:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:5569:x1876270616938752:12345-192.168.201.52@tcp:41: 00000004:00000024:0.0:1789351169.460238:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789351169.460320:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351169.460340:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:5569:x1876270616938752:12345-192.168.201.52@tcp:41: Request processed in 145us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351169.460353:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:0.0:1789351169.460420:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616938624 00000100:00100000:0.0:1789351169.460424:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616938624 00000100:00100000:0.0:1789351169.460445:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:0.0:1789351169.460452:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:0:x1876270616938624:12345-192.168.201.52@tcp:41: 00000004:00000024:0.0:1789351169.460464:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789351169.460485:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:0:x1876270616938624:12345-192.168.201.52@tcp:41: Request processed in 33us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351169.460490:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:3.0:1789351169.462525:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351169.462651:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616938880 00000100:00100000:0.0:1789351169.462659:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616938880 00000100:00100000:0.0:1789351169.462768:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:0.0:1789351169.462779:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:5569:x1876270616938880:12345-192.168.201.52@tcp:40: 00000100:00100000:0.0:1789351169.462850:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:5569:x1876270616938880:12345-192.168.201.52@tcp:40: Request processed in 72us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351169.462858:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:1.0:1789351169.468474:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351169.468503:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351169.468547:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616939008 00000100:00100000:3.0:1789351169.468558:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616939008 00000100:00100000:0.0:1789351169.468572:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616939136 00000100:00100000:0.0:1789351169.468578:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616939136 00000100:00100000:3.0:1789351169.468608:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:3.0:1789351169.468616:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1876270616939008:12345-192.168.201.52@tcp:8: 00010000:00080000:3.0:1789351169.468645:0:6661:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp t0 exp 0000000000000000 cur 113 last 0 00000020:00000080:3.0:1789351169.468843:0:6661:0:(genops.c:1406:class_connect()) connect: client 8237986d-b9e8-417a-ac8f-a078390d268c, cookie 0xa6ea017771df6b66 00002000:00100000:3.0:1789351169.468855:0:6661:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8237986d-b9e8-417a-ac8f-a078390d268c/ffff8d2cd84a3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789351169.468865:0:6661:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789351169.469038:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351169.469100:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351169.469140:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616939392 00000100:00100000:1.0:1789351169.469148:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616939392 00000100:00100000:1.0:1789351169.469191:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:1.0:1789351169.469201:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:2350:x1876270616939392:12345-192.168.201.52@tcp:400: 00000100:00100000:1.0:1789351169.469266:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:2350:x1876270616939392:12345-192.168.201.52@tcp:400: Request processed in 67us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351169.469273:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:2.0:1789351169.469337:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616939264 00000100:00100000:2.0:1789351169.469342:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616939264 00000100:00100000:2.0:1789351169.469390:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:2.0:1789351169.469399:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+6:5569:x1876270616939264:12345-192.168.201.52@tcp:33: 00002000:00080000:3.0:1789351169.469921:0:6661:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789351169.470219:0:6661:0:(import.c:65:import_set_state_nolock()) ffff8d2cd84a5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789351169.470349:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:2346:x1876270616939008:12345-192.168.201.52@tcp:8: Request processed in 1732us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351169.470380:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:3.0:1789351169.470397:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:3.0:1789351169.470403:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1876270616939136:12345-192.168.201.52@tcp:8: 00010000:00080000:3.0:1789351169.470421:0:6661:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp t0 exp 0000000000000000 cur 113 last 0 00000020:00000080:3.0:1789351169.470444:0:6661:0:(genops.c:1406:class_connect()) connect: client 8237986d-b9e8-417a-ac8f-a078390d268c, cookie 0xa6ea017771df6b6d 00002000:00100000:3.0:1789351169.470452:0:6661:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8237986d-b9e8-417a-ac8f-a078390d268c/ffff8d2cd84a1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789351169.470470:0:6661:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789351169.470707:0:6661:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789351169.470723:0:6661:0:(import.c:65:import_set_state_nolock()) ffff8d2cd83af000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789351169.470747:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:2346:x1876270616939136:12345-192.168.201.52@tcp:8: Request processed in 343us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351169.470753:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000004:00080000:2.0:1789351169.485317:0:5825:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 15866us 00000004:00200000:1.0:1789351169.496002:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1789351169.496178:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+6:5569:x1876270616939264:12345-192.168.201.52@tcp:33: Request processed in 26775us (27135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351169.496192:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:1.0:1789351169.597256:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351169.599623:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616939520 00000100:00100000:3.0:1789351169.599638:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616939520 00000100:00100000:3.0:1789351169.599765:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:3.0:1789351169.599777:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+6:5609:x1876270616939520:12345-192.168.201.52@tcp:101: 00010000:00010000:3.0:1789351169.599797:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351169.599859:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df6b74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7bb5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.599924:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df6b7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.599938:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df6b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.599970:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df6b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351169.600194:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1789351169.600199:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351169.600270:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df6b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.600298:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df6b74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bb5 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.600317:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df6b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bb5 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.600326:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce058fe00) 00010000:00010000:3.0:1789351169.600329:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789351169.600332:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d02045c00, rc 0) 00000100:00100000:3.0:1789351169.600481:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+7:5609:x1876270616939520:12345-192.168.201.52@tcp:101: Request processed in 705us (3234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351169.600488:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 10000000:01000000:0.0:1789351169.697511:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789351169.697518:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d2cf76fd000 from 30 10000000:01000000:0.0:1789351169.697524:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789351169.697586:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031c00/0xa6ea017771df6b82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.697598:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031c00/0xa6ea017771df6b82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.697626:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031c00/0xa6ea017771df6b82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351169.697650:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626390656:0@lo:101: 00000100:00100000:0.0:1789351169.697732:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351169.697814:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3fdde40 going to sleep for 11 seconds 00000100:00100000:3.0:1789351169.697894:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626390656 00000100:00100000:3.0:1789351169.697901:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626390656 00000100:00100000:3.0:1789351169.697946:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789351169.697960:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+13:5820:x1876270626390656:12345-0@lo:101: 00010000:00010000:3.0:1789351169.697972:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351169.697984:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d02044200/0xa6ea017771df6b89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6b82 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.698016:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d02044200/0xa6ea017771df6b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6b82 expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.698033:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d02044200/0xa6ea017771df6b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6b82 expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.698046:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d02044200, rc 0) 00000100:00100000:3.0:1789351169.698092:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626390656:12345-0@lo:101: Request processed in 134us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351169.698103:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789351169.698288:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626390656:0@lo:101: 00010000:00010000:0.0:1789351169.698302:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031c00/0xa6ea017771df6b82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6b89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.698311:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031c00/0xa6ea017771df6b82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6b89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351169.698395:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626390784:0@lo:501: 00000100:00100000:0.0:1789351169.698425:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351169.698450:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3fdde40 going to sleep for 11 seconds 00000100:00100000:1.0:1789351169.698497:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626390784 00000100:00100000:1.0:1789351169.698502:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626390784 00000100:00100000:1.0:1789351169.698532:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789351169.698548:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626390784:12345-0@lo:501: 00000100:00100000:1.0:1789351169.698803:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626390784:12345-0@lo:501: Request processed in 255us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351169.698810:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789351169.698907:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626390784:0@lo:501: 00000100:00100000:0.0:1789351169.698932:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626390912:0@lo:503: 00000100:00100000:0.0:1789351169.698964:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351169.698984:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3fdde40 going to sleep for 11 seconds 00000100:00100000:1.0:1789351169.699031:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626390912 00000100:00100000:1.0:1789351169.699035:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626390912 00000100:00100000:1.0:1789351169.699063:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789351169.699070:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626390912:12345-0@lo:503: 00000100:00100000:1.0:1789351169.699256:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626390912:12345-0@lo:503: Request processed in 187us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351169.699262:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789351169.699342:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626390912:0@lo:503: 00000100:00100000:2.0:1789351169.699728:0:8174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1622a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8174:1876270626391040:0@lo:502: 00000100:00100000:2.0:1789351169.699760:0:8174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351169.699786:0:8174:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351169.699831:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626391040 00000100:00100000:3.0:1789351169.699836:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626391040 00000100:00100000:3.0:1789351169.699863:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789351169.699870:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+14:8174:x1876270626391040:12345-0@lo:502: 00000100:00100000:3.0:1789351169.700054:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+14:8174:x1876270626391040:12345-0@lo:502: Request processed in 184us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351169.700061:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789351169.700139:0:8174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1622a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8174:1876270626391040:0@lo:502: 00000100:00100000:2.0:1789351169.700178:0:8174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1622a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8174:1876270626391168:0@lo:502: 00000100:00100000:2.0:1789351169.700215:0:8174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351169.700237:0:8174:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789351169.700293:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626391168 00000100:00100000:0.0:1789351169.700297:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626391168 00000100:00100000:0.0:1789351169.700317:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789351169.700324:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+14:8174:x1876270626391168:12345-0@lo:502: 00000100:00100000:0.0:1789351169.700478:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+14:8174:x1876270626391168:12345-0@lo:502: Request processed in 155us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351169.700490:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789351169.700572:0:8174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1622a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8174:1876270626391168:0@lo:502: 00000040:00080000:2.0:1789351169.700591:0:8174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789351169.702683:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789351169.702716:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789351169.702727:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031c00/0xa6ea017771df6b82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6b89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.702739:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031c00/0xa6ea017771df6b82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6b89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351169.702749:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789351169.702752:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789351169.702755:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789351169.702788:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.702796:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.702806:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351169.702829:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626391296:0@lo:101: 00000100:00100000:0.0:1789351169.702892:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351169.702936:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3fdde40 going to sleep for 11 seconds 00000100:00100000:1.0:1789351169.703010:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626391296 00000100:00100000:1.0:1789351169.703018:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626391296 00000100:00100000:1.0:1789351169.703061:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789351169.703069:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626391296:12345-0@lo:101: 00010000:00010000:1.0:1789351169.703080:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351169.703091:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6b97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6b90 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351169.703112:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6b90 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351169.703121:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6b90 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351169.703129:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cd5931c00, rc 0) 00000100:00100000:1.0:1789351169.703169:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626391296:12345-0@lo:101: Request processed in 101us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351169.703175:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789351169.703314:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626391296:0@lo:101: 00010000:00010000:0.0:1789351169.703328:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6b90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6b97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.703336:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6b90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6b97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351169.703414:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626391424:0@lo:501: 00000100:00100000:0.0:1789351169.703441:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351169.703462:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3fdde40 going to sleep for 11 seconds 00000100:00100000:1.0:1789351169.703558:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626391424 00000100:00100000:1.0:1789351169.703562:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626391424 00000100:00100000:1.0:1789351169.703590:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789351169.703596:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626391424:12345-0@lo:501: 00000100:00100000:1.0:1789351169.703827:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626391424:12345-0@lo:501: Request processed in 230us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351169.703834:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789351169.703923:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626391424:0@lo:501: 00000100:00100000:0.0:1789351169.703949:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626391552:0@lo:503: 00000100:00100000:0.0:1789351169.703984:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351169.704010:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3fdde40 going to sleep for 11 seconds 00000100:00100000:3.0:1789351169.704063:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626391552 00000100:00100000:3.0:1789351169.704067:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626391552 00000100:00100000:3.0:1789351169.704096:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789351169.704104:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626391552:12345-0@lo:503: 00000100:00100000:3.0:1789351169.704419:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626391552:12345-0@lo:503: Request processed in 315us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351169.704427:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789351169.704525:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626391552:0@lo:503: 00000100:00100000:2.0:1789351169.705240:0:8175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1622a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8175:1876270626391680:0@lo:502: 00000100:00100000:2.0:1789351169.705287:0:8175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351169.705325:0:8175:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941600 going to sleep for 11 seconds 00000100:00100000:0.0:1789351169.705386:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626391680 00000100:00100000:0.0:1789351169.705392:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626391680 00000100:00100000:0.0:1789351169.705422:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789351169.705430:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+15:8175:x1876270626391680:12345-0@lo:502: 00000100:00100000:0.0:1789351169.705635:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+15:8175:x1876270626391680:12345-0@lo:502: Request processed in 205us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351169.705642:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789351169.705808:0:8175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1622a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8175:1876270626391680:0@lo:502: 00000020:01000000:2.0:1789351169.705836:0:8175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789351169.705845:0:8175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351169.705847:0:8175:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789351169.705853:0:8175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789351169.705855:0:8175:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789351169.705869:0:8175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1622a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8175:1876270626391808:0@lo:502: 00000100:00100000:2.0:1789351169.705898:0:8175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351169.705923:0:8175:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941600 going to sleep for 11 seconds 00000100:00100000:1.0:1789351169.705970:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626391808 00000100:00100000:1.0:1789351169.705975:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626391808 00000100:00100000:1.0:1789351169.706004:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789351169.706011:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+15:8175:x1876270626391808:12345-0@lo:502: 00000100:00100000:1.0:1789351169.706132:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+15:8175:x1876270626391808:12345-0@lo:502: Request processed in 121us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351169.706139:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789351169.706205:0:8175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1622a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8175:1876270626391808:0@lo:502: 00000020:01000000:2.0:1789351169.706220:0:8175:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789351169.706224:0:8175:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351169.706226:0:8175:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789351169.706229:0:8175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1789351169.706384:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789351169.706404:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789351169.706413:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6b90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6b97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.706430:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6b97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351169.706439:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789351169.706442:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d2cc5fed000 from 30 10000000:01000000:3.0:1789351169.706445:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789351169.706468:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d02045200/0xa6ea017771df6b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.706475:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d02045200/0xa6ea017771df6b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.706484:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d02045200/0xa6ea017771df6b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351169.706497:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626391936:0@lo:101: 00000100:00100000:3.0:1789351169.706524:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351169.706561:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc311ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789351169.706599:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626391936 00000100:00100000:0.0:1789351169.706604:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626391936 00000100:00100000:0.0:1789351169.706643:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789351169.706651:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626391936:12345-0@lo:101: 00010000:00010000:0.0:1789351169.706661:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351169.706672:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cc0031600/0xa6ea017771df6ba5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6b9e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.706690:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cc0031600/0xa6ea017771df6ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6b9e expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.706706:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cc0031600/0xa6ea017771df6ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6b9e expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.706712:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0031600, rc 0) 00000100:00100000:0.0:1789351169.706739:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626391936:12345-0@lo:101: Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351169.706743:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789351169.706774:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626391936:0@lo:101: 00010000:00010000:3.0:1789351169.706791:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d02045200/0xa6ea017771df6b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6ba5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.706799:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d02045200/0xa6ea017771df6b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6ba5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351169.706839:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626392064:0@lo:501: 00000100:00100000:3.0:1789351169.706861:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351169.706923:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc311ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789351169.706971:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626392064 00000100:00100000:1.0:1789351169.706975:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626392064 00000100:00100000:1.0:1789351169.707052:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789351169.707060:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626392064:12345-0@lo:501: 00000100:00100000:1.0:1789351169.707253:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626392064:12345-0@lo:501: Request processed in 193us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351169.707260:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789351169.707317:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626392064:0@lo:501: 00000100:00100000:3.0:1789351169.707343:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626392192:0@lo:503: 00000100:00100000:3.0:1789351169.707404:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351169.707597:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc311ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789351169.707655:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626392192 00000100:00100000:0.0:1789351169.707660:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626392192 00000100:00100000:0.0:1789351169.707679:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789351169.707686:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626392192:12345-0@lo:503: 00000100:00100000:0.0:1789351169.707817:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626392192:12345-0@lo:503: Request processed in 131us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351169.707824:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789351169.707898:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626392192:0@lo:503: 00000100:00100000:3.0:1789351169.708210:0:8176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8176:1876270626392320:0@lo:502: 00000100:00100000:3.0:1789351169.708242:0:8176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351169.708263:0:8176:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc311ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789351169.708308:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626392320 00000100:00100000:0.0:1789351169.708312:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626392320 00000100:00100000:0.0:1789351169.708328:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789351169.708333:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+16:8176:x1876270626392320:12345-0@lo:502: 00000100:00100000:0.0:1789351169.708494:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+16:8176:x1876270626392320:12345-0@lo:502: Request processed in 161us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351169.708501:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789351169.708585:0:8176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8176:1876270626392320:0@lo:502: 00000100:00100000:3.0:1789351169.708621:0:8176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8176:1876270626392448:0@lo:502: 00000100:00100000:3.0:1789351169.708649:0:8176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351169.708674:0:8176:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc311ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789351169.708720:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626392448 00000100:00100000:0.0:1789351169.708724:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626392448 00000100:00100000:0.0:1789351169.708741:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789351169.708746:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+16:8176:x1876270626392448:12345-0@lo:502: 00000100:00100000:0.0:1789351169.708867:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+16:8176:x1876270626392448:12345-0@lo:502: Request processed in 121us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351169.708878:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789351169.708951:0:8176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8176:1876270626392448:0@lo:502: 00000040:00080000:3.0:1789351169.708969:0:8176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789351169.709098:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789351169.709114:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789351169.709121:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d02045200/0xa6ea017771df6b9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6ba5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.709131:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d02045200/0xa6ea017771df6b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6ba5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351169.709139:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789351169.709142:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d2cc5fed000 from 5 10000000:01000000:0.0:1789351169.709144:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789351169.709165:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.709172:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.709180:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351169.709190:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626392576:0@lo:101: 00000100:00100000:0.0:1789351169.709215:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351169.709235:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3fdd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351169.709278:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626392576 00000100:00100000:3.0:1789351169.709282:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626392576 00000100:00100000:3.0:1789351169.709298:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789351169.709303:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626392576:12345-0@lo:101: 00010000:00010000:3.0:1789351169.709310:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351169.709321:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d02045000/0xa6ea017771df6bb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6bac expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.709342:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d02045000/0xa6ea017771df6bb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6bac expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.709391:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d02045000/0xa6ea017771df6bb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6bac expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.709399:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d02045000, rc 0) 00000100:00100000:3.0:1789351169.709425:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626392576:12345-0@lo:101: Request processed in 122us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351169.709431:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789351169.709489:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626392576:0@lo:101: 00010000:00010000:0.0:1789351169.709501:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6bb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.709508:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6bb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351169.709564:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626392704:0@lo:256: 00000100:00100000:0.0:1789351169.709592:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351169.709617:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3fdd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351169.709741:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626392704 00000100:00100000:3.0:1789351169.709745:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626392704 00000100:00100000:3.0:1789351169.709761:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789351169.709766:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626392704:12345-0@lo:256: 20000000:01000000:3.0:1789351169.709778:0:5816:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789351169.709795:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789351169.709798:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789351169.709864:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626392704:12345-0@lo:256: Request processed in 97us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351169.709871:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789351169.709932:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626392704:0@lo:256: 10000000:01000000:0.0:1789351169.709970:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789351169.709975:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6bb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.709982:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6bb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351169.709988:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789351169.709990:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789351169.709992:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789351169.710005:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030800/0xa6ea017771df6bba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.710012:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030800/0xa6ea017771df6bba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.710019:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030800/0xa6ea017771df6bba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351169.710029:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626392832:0@lo:101: 00000100:00100000:0.0:1789351169.710052:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351169.710072:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3fdd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351169.710115:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626392832 00000100:00100000:3.0:1789351169.710118:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626392832 00000100:00100000:3.0:1789351169.710134:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789351169.710140:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626392832:12345-0@lo:101: 00010000:00010000:3.0:1789351169.710146:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351169.710153:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6bc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6bba expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.710165:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6bc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6bba expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.710183:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6bc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6bba expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.710189:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c4000, rc 0) 00000100:00100000:3.0:1789351169.710225:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626392832:12345-0@lo:101: Request processed in 85us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351169.710231:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789351169.710290:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626392832:0@lo:101: 00010000:00010000:0.0:1789351169.710304:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030800/0xa6ea017771df6bba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6bc1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.710312:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030800/0xa6ea017771df6bba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6bc1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351169.710346:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626392960:0@lo:501: 00000100:00100000:0.0:1789351169.710399:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351169.710412:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3fdd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351169.710465:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626392960 00000100:00100000:3.0:1789351169.710469:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626392960 00000100:00100000:3.0:1789351169.710484:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789351169.710489:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626392960:12345-0@lo:501: 00000100:00100000:3.0:1789351169.710713:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626392960:12345-0@lo:501: Request processed in 223us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351169.710720:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789351169.710781:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626392960:0@lo:501: 00000100:00100000:0.0:1789351169.710804:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626393088:0@lo:503: 00000100:00100000:0.0:1789351169.710835:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351169.710861:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3fdd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351169.710928:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626393088 00000100:00100000:1.0:1789351169.710932:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626393088 00000100:00100000:1.0:1789351169.710953:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789351169.710959:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626393088:12345-0@lo:503: 00000100:00100000:1.0:1789351169.711221:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626393088:12345-0@lo:503: Request processed in 261us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351169.711236:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789351169.711334:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626393088:0@lo:503: 00000100:00100000:0.0:1789351169.711986:0:8177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8177:1876270626393216:0@lo:502: 00000100:00100000:0.0:1789351169.712023:0:8177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351169.712050:0:8177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3fddcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351169.712100:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626393216 00000100:00100000:1.0:1789351169.712105:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626393216 00000100:00100000:1.0:1789351169.712135:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789351169.712142:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+18:8177:x1876270626393216:12345-0@lo:502: 00000100:00100000:1.0:1789351169.712464:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+18:8177:x1876270626393216:12345-0@lo:502: Request processed in 321us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351169.712472:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789351169.712777:0:8177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8177:1876270626393216:0@lo:502: 00000020:01000000:0.0:1789351169.712803:0:8177:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789351169.712810:0:8177:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789351169.712817:0:8177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789351169.712819:0:8177:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789351169.712824:0:8177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789351169.712828:0:8177:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:0.0:1789351169.712859:0:8177:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789351169.712862:0:8177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789351169.712888:0:8177:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d2cc6f1b380) 00000020:00000080:0.0:1789351169.712909:0:8177:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789351169.712914:0:8177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789351169.712983:0:8177:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789351169.712988:0:8177:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789351169.712994:0:8177:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6ea017771df6bcf 00010000:00080000:0.0:1789351169.713025:0:8177:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2d00814000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:0.0:1789351169.713249:0:8177:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1789351169.713675:0:8177:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789351169.713686:0:8177:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789351169.714183:0:8177:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789351169.714506:0:8177:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789351169.714573:0:8177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789351169.714635:0:8177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789351169.715113:0:8178:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789351169.715117:0:8178:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789351169.716028:0:8177:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789351169.716039:0:8177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789351169.716069:0:8177:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789351169.716092:0:8177:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6ea017771df6bd6 00000100:00080000:0.0:1789351169.716103:0:8177:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789351169.716108:0:8177:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2d00814000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789351169.716143:0:8177:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2cf95fc000 x1876270626393344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789351169.716283:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626393344:0@lo:8: 00000100:00100000:1.0:1789351169.716353:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351169.716527:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626393344 00000100:00100000:2.0:1789351169.716544:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626393344 00000100:00100000:2.0:1789351169.716581:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789351169.716589:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1876270626393344:12345-0@lo:8: 00010000:00080000:2.0:1789351169.716612:0:6660:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 114 last 0 00000020:00000080:2.0:1789351169.716639:0:6660:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6ea017771df6bdd 00002000:00100000:2.0:1789351169.716658:0:6660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d2bc1e6f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789351169.716663:0:6660:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789351169.716667:0:6660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789351169.716758:0:6660:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789351169.716870:0:6660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789351169.716893:0:6660:0:(import.c:65:import_set_state_nolock()) ffff8d2bc1e6c800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789351169.717042:0:8177:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789351169.717104:0:8177:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789351169.717108:0:8177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789351169.717111:0:8177:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789351169.717113:0:8177:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789351169.717118:0:8177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789351169.717119:0:8177:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789351169.717128:0:8177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789351169.717130:0:8177:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789351169.717154:0:8177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8177:1876270626393472:0@lo:502: 00000100:00100000:0.0:1789351169.717200:0:8177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351169.717219:0:8177:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd2429cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351169.717278:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626393472 00000100:00100000:3.0:1789351169.717282:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626393472 00000100:00100000:3.0:1789351169.717318:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789351169.717325:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:8177:x1876270626393472:12345-0@lo:502: 00000100:00100000:3.0:1789351169.717560:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:8177:x1876270626393472:12345-0@lo:502: Request processed in 235us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351169.717568:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789351169.717618:0:8177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8177:1876270626393472:0@lo:502: 00000020:01000000:3.0:1789351169.717643:0:8177:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351169.717648:0:8177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351169.717649:0:8177:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789351169.717653:0:8177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1789351169.717752:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1789351169.717767:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789351169.717776:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030800/0xa6ea017771df6bba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6bc1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.717786:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030800/0xa6ea017771df6bba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6bc1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351169.717795:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789351169.717797:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2cd83919c0 from 1 10000000:01000000:3.0:1789351169.717800:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789351169.717822:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4a00/0xa6ea017771df6be4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.717830:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4a00/0xa6ea017771df6be4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.717839:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4a00/0xa6ea017771df6be4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351169.717852:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626393600:0@lo:101: 00000100:00100000:3.0:1789351169.717880:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351169.717897:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc311ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789351169.717954:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626393600 00000100:00100000:0.0:1789351169.717958:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626393600 00000100:00100000:0.0:1789351169.717986:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789351169.717992:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626393600:12345-0@lo:101: 00010000:00010000:0.0:1789351169.718000:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351169.718024:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecd9600/0xa6ea017771df6beb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6be4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.718044:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecd9600/0xa6ea017771df6beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6be4 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.718054:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecd9600/0xa6ea017771df6beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6be4 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351169.718062:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9600, rc 0) 00000100:00100000:0.0:1789351169.718090:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:5820:x1876270626393600:12345-0@lo:101: Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351169.718095:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789351169.718163:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626393600:0@lo:101: 00010000:00010000:3.0:1789351169.718175:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4a00/0xa6ea017771df6be4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6beb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351169.718183:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4a00/0xa6ea017771df6be4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6beb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351169.718233:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626393728:0@lo:501: 00000100:00100000:3.0:1789351169.718258:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351169.718322:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc311ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789351169.718443:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1876270626393344:12345-0@lo:8: Request processed in 1853us (2089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351169.718451:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789351169.718497:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf95fc000 x1876270626393344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789351179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351169.718507:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789351169.718513:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789351169.718520:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789351169.718525:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789351169.718527:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2d00814000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789351169.718548:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789351169.718553:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626393344:0@lo:8: 00000100:00100000:0.0:1789351169.718742:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626393728 00000100:00100000:0.0:1789351169.718747:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626393728 00000100:00100000:0.0:1789351169.718765:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789351169.718771:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:5820:x1876270626393728:12345-0@lo:501: 00000100:00100000:0.0:1789351169.718968:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:5820:x1876270626393728:12345-0@lo:501: Request processed in 196us (709us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789351169.718984:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000004:00080000:0.0:1789351169.719011:0:8178:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789351169.719095:0:8178:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 114164736567ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789351169.719164:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626393728:0@lo:501: 10000000:01000000:1.0:1789351169.719186:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789351169.719191:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4a00/0xa6ea017771df6be4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6beb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351169.719199:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4a00/0xa6ea017771df6be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6beb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351169.719267:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626394112:0@lo:400: 00000100:00100000:3.0:1789351169.719295:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351169.719374:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789351169.719381:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626394240:0@lo:400: 00000100:00100000:3.0:1789351169.719406:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351169.719472:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626394240 00000100:00100000:0.0:1789351169.719477:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626394240 00000100:00100000:0.0:1789351169.719524:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789351169.719531:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876270626394240:12345-0@lo:400: 00000100:00100000:0.0:1789351169.719576:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876270626394240:12345-0@lo:400: Request processed in 46us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351169.719583:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789351169.719632:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351169.719652:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626394240:0@lo:400: 00000100:00100000:2.0:1789351169.719753:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626393856:0@lo:400: 00000100:00100000:2.0:1789351169.719781:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351169.719804:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789351169.719810:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876270626393984:0@lo:400: 00000100:00100000:2.0:1789351169.719831:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351169.720557:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626394112 00000100:00100000:1.0:1789351169.720563:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626394112 00000100:00100000:1.0:1789351169.720602:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789351169.720611:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626394112:12345-0@lo:400: 00000100:00100000:1.0:1789351169.720655:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626394112:12345-0@lo:400: Request processed in 46us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351169.720661:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789351169.720755:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626393856 00000100:00100000:0.0:1789351169.720759:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626393856 00000100:00100000:1.0:1789351169.722481:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626393984 00000100:00100000:1.0:1789351169.722491:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626393984 00000100:00100000:1.0:1789351169.722515:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789351169.722524:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626393856:12345-0@lo:400: 00000100:00100000:1.0:1789351169.722605:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626393856:12345-0@lo:400: Request processed in 82us (2823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351169.722612:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789351169.722625:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789351169.722632:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876270626393984:12345-0@lo:400: 00000100:00100000:1.0:1789351169.722659:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876270626393984:12345-0@lo:400: Request processed in 28us (2827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351169.722665:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789351169.722704:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876270626393984:0@lo:400: 00000100:00100000:1.0:1789351169.722723:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626393856:0@lo:400: 00000100:00080000:1.0:1789351169.725274:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789351169.725283:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789351169.725526:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc6f65c00 x1876270626394112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351169.725555:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626394112:0@lo:400: 00000004:00080000:3.0:1789351169.746647:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:3.0:1789351169.746682:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8237986d-b9e8-417a-ac8f-a078390d268c 00000100:00100000:2.0:1789351169.746896:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626394368:0@lo:13: 00000100:00100000:2.0:1789351169.746968:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789351169.747106:0:8179:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789351169.747132:0:8179:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8179:1876270626394496:0@lo:7: 00000100:00100000:1.0:1789351169.747170:0:8179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351169.747188:0:8179:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc30316c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789351169.747261:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626394368 00000100:00100000:0.0:1789351169.747268:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626394368 00000100:00080000:1.0:1789351169.747372:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789351169.747420:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789351169.747431:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1876270626394368:12345-0@lo:13: 00002000:00000024:0.0:1789351169.747450:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789351169.747583:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1876270626394368:12345-0@lo:13: Request processed in 155us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351169.747591:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789351169.747649:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc6f67480 x1876270626394368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351169.747667:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626394368:0@lo:13: 00000100:00100000:2.0:1789351169.747690:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626394496 00000100:00100000:2.0:1789351169.747694:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626394496 00000100:00100000:2.0:1789351169.747760:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789351169.747767:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8179:x1876270626394496:12345-0@lo:7: 00002000:00080000:2.0:1789351169.751599:0:6660:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1789351169.751606:0:6660:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789351169.751690:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8179:x1876270626394496:12345-0@lo:7: Request processed in 3920us (4515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351169.751706:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789351169.752820:0:8179:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc6f64700 x1876270626394496/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789351185 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351169.752836:0:8179:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8179:1876270626394496:0@lo:7: 00000004:00080000:1.0:1789351169.752848:0:8179:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789351169.752886:0:8179:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8179:1876270626394624:0@lo:5: 00000100:00100000:1.0:1789351169.752923:0:8179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351169.753065:0:8179:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc30316c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351169.753283:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626394624 00000100:00100000:3.0:1789351169.753289:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626394624 00000100:00100000:3.0:1789351169.753334:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789351169.753344:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8179:x1876270626394624:12345-0@lo:5: 00002000:00080000:3.0:1789351169.753382:0:6663:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789351169.753386:0:6663:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789351169.753655:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8179:x1876270626394624:12345-0@lo:5: Request processed in 312us (731us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789351169.753662:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789351169.753825:0:8179:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc6f64700 x1876270626394624/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789351185 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351169.753838:0:8179:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8179:1876270626394624:0@lo:5: 00000004:00080000:0.0:1789351169.753847:0:8179:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789351169.753868:0:8179:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8179:1876270626394752:0@lo:700: 00000100:00100000:0.0:1789351169.753895:0:8179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351169.753968:0:8179:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789351169.754005:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626394752 00000100:00100000:2.0:1789351169.754010:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626394752 00000100:00100000:2.0:1789351169.754078:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789351169.754087:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8179:x1876270626394752:12345-0@lo:700: 00000100:00100000:2.0:1789351169.754117:0:6669:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1622d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6669:1876270626394880:0@lo:700: 00000100:00100000:2.0:1789351169.754144:0:6669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351169.754174:0:6669:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc39410c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789351169.754222:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626394880 00000100:00100000:0.0:1789351169.754225:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626394880 00000100:00100000:0.0:1789351169.754262:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789351169.754268:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6669:x1876270626394880:12345-0@lo:700: 40000000:02000000:0.0:1789351169.772511:0:5829:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1789351169.775999:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6669:x1876270626394880:12345-0@lo:700: Request processed in 21722us (21844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351169.776018:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789351169.776102:0:6669:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1622d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6669:1876270626394880:0@lo:700: 40000000:02000000:0.0:1789351169.776115:0:6669:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:1.0:1789351169.810623:0:7616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789351169.810640:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1789351169.810649:0:7616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8237986d-b9e8-417a-ac8f-a078390d268c 00000100:00100000:3.0:1789351169.810781:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8179:x1876270626394752:12345-0@lo:700: Request processed in 56682us (56872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351169.810809:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789351169.810907:0:8179:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf95fc380 x1876270626394752/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789351185 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351169.810921:0:8179:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789351169.810938:0:8179:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8179:1876270626394752:0@lo:700: 00000004:02000040:0.0:1789351169.832452:0:8179:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789351169.835424:0:8179:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8179:1876270626395008:0@lo:5: 00000100:00100000:0.0:1789351169.835481:0:8179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351169.835543:0:8179:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789351169.835558:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626395008 00000100:00100000:2.0:1789351169.835565:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626395008 00000100:00100000:2.0:1789351169.835760:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789351169.835770:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8179:x1876270626395008:12345-0@lo:5: 00002000:00080000:3.0:1789351169.841740:0:6660:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789351169.841762:0:6660:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789351169.845870:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8179:x1876270626395008:12345-0@lo:5: Request processed in 10095us (10380us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789351169.845882:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789351169.846252:0:8179:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf95fc380 x1876270626395008/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789351185 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351169.846270:0:8179:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8179:1876270626395008:0@lo:5: 00000004:00080000:0.0:1789351169.846285:0:8179:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1789351170.017602:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351171.041645:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351171.230564:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351171.230683:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616939648 00000100:00100000:1.0:1789351171.230698:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616939648 00000100:00080000:3.0:1789351171.230775:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789351171.230796:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1789351171.230812:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:5661:x1876270616939648:12345-192.168.201.52@tcp:41: 00000004:00000024:1.0:1789351171.230871:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789351171.230952:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:5661:x1876270616939648:12345-192.168.201.52@tcp:41: Request processed in 145us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351171.230960:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:2.0:1789351171.233861:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351171.233939:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616939776 00000100:00100000:3.0:1789351171.233950:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616939776 00000100:00100000:3.0:1789351171.234026:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00080000:1.0:1789351171.234027:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789351171.234041:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8237986d-b9e8-417a-ac8f-a078390d268c+6:5661:x1876270616939776:12345-192.168.201.52@tcp:13: 00002000:00000024:3.0:1789351171.234084:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789351171.234174:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8237986d-b9e8-417a-ac8f-a078390d268c+6:5661:x1876270616939776:12345-192.168.201.52@tcp:13: Request processed in 137us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351171.234184:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:3.0:1789351171.235250:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351171.235296:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616939904 00000100:00100000:0.0:1789351171.235304:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616939904 00000100:00100000:0.0:1789351171.235355:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00080000:1.0:1789351171.235387:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789351171.235422:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8237986d-b9e8-417a-ac8f-a078390d268c+5:5661:x1876270616939904:12345-192.168.201.52@tcp:13: 00002000:00000024:0.0:1789351171.235440:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789351171.235502:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8237986d-b9e8-417a-ac8f-a078390d268c+5:5661:x1876270616939904:12345-192.168.201.52@tcp:13: Request processed in 83us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351171.235520:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00010000:00010000:2.0:1789351172.065586:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789351172.597023:0:8264:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789351172.769629:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789351172.769666:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626395136:0@lo:13: 00000100:00100000:2.0:1789351172.769761:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351172.769901:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626395136 00000100:00100000:0.0:1789351172.769911:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626395136 00000100:00080000:1.0:1789351172.769948:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789351172.769992:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789351172.770005:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626395136:12345-0@lo:13: 00002000:00000024:0.0:1789351172.770050:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789351172.770115:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626395136:12345-0@lo:13: Request processed in 113us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351172.770123:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789351172.770168:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc6f64700 x1876270626395136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351172.770190:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626395136:0@lo:13: 00010000:00010000:0.0:1789351173.089526:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351174.113663:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789351174.225967:0:8411:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd052e2ee0 20000000:00000080:1.0:1789351174.225981:0:8411:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2bc19a3000 uarg=0000000000000000 20000000:01000000:1.0:1789351174.226011:0:8411:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789351174.226019:0:8411:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789351174.226022:0:8411:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789351174.226027:0:8411:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789351174.226032:0:8411:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789351174.226045:0:8411:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789351174.226047:0:8411:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789351174.226187:0:8411:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789351174.226189:0:8411:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789351174.226749:0:8412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1789351174.227153:0:8411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1789351174.227185:0:8411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1789351174.227203:0:8411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1789351174.227210:0:8411:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789351174.227211:0:8411:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789351174.228222:0:8413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789351174.228663:0:8411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789351174.228717:0:8411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1789351174.228754:0:8411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1789351174.228766:0:8411:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789351174.228768:0:8411:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789351174.229199:0:8414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1789351174.229543:0:8411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1789351174.229574:0:8411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1789351174.229603:0:8411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1789351174.229611:0:8411:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789351174.229612:0:8411:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789351174.229937:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1789351174.230184:0:8411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1789351174.230225:0:8411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1789351174.230265:0:8411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1789351174.230286:0:8411:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789351174.230306:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6bf2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.230322:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d02044400/0xa6ea017771df6aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6ae8 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.230335:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d02044000/0xa6ea017771df6b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6b12 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.230341:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cd5931400/0xa6ea017771df6b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b53 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.230346:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d02045a00/0xa6ea017771df6b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b5a expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.230350:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d02044200/0xa6ea017771df6b89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6b82 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.230354:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6b90 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.230503:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cc0031600/0xa6ea017771df6ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6b9e expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.230510:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6bc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6bba expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.230517:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ceecd9600/0xa6ea017771df6beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6be4 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.230524:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6bf2 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.230558:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ceecd9600/0xa6ea017771df6beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6be4 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.230576:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2ceecd9600/0xa6ea017771df6beb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6be4 expref: 18 pid: 5817 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351174.230588:0:8411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f67480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626395264:0@lo:104: 00000100:00100000:1.0:1789351174.230644:0:8411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351174.230679:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626395264 00000100:00100000:3.0:1789351174.230686:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626395264 00010000:00010000:1.0:1789351174.230692:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6bc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6bba expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.230698:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6bc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6bba expref: 18 pid: 5816 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351174.230705:0:8411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f66300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626395392:0@lo:104: 00000100:00100000:1.0:1789351174.230719:0:8411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351174.230734:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626395392 00000100:00100000:3.0:1789351174.230737:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626395392 00000100:00100000:3.0:1789351174.230752:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789351174.230764:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+4:8411:x1876270626395264:12345-0@lo:104: 00000100:00100000:2.0:1789351174.230765:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789351174.230769:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cc0031600/0xa6ea017771df6ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6b9e expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.230778:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2cc0031600/0xa6ea017771df6ba5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6b9e expref: 18 pid: 5814 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351174.230779:0:7614:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00010000:00010000:3.0:1789351174.230780:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4a00/0xa6ea017771df6be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6beb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.230780:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+4:8411:x1876270626395392:12345-0@lo:104: 00000100:00100000:0.0:1789351174.230793:0:7614:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:2.0:1789351174.230796:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030800/0xa6ea017771df6bba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6bc1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351174.230804:0:8411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626395520:0@lo:104: 00010000:00010000:3.0:1789351174.230850:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789351174.230859:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+4:8411:x1876270626395264:12345-0@lo:104: Request processed in 97us (211us total) trans 0 rc 0/0 00010000:00010000:2.0:1789351174.230860:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789351174.230860:0:8411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351174.230865:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+4:8411:x1876270626395392:12345-0@lo:104: Request processed in 91us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351174.230875:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789351174.230880:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6b90 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351174.230884:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789351174.230888:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789351174.230896:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4a00/0xa6ea017771df6be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6beb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.230902:0:5805:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:3.0:1789351174.230906:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626395520 00010000:00010000:1.0:1789351174.230911:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6b97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6b90 expref: 18 pid: 5816 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351174.230912:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626395520 00010000:00010000:0.0:1789351174.230914:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c4a00 already unused, calling callback (ffffffffc1cf8c20) 00010000:00010000:2.0:1789351174.230918:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1789351174.230921:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4a00/0xa6ea017771df6be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6beb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351174.230927:0:8411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626395648:0@lo:104: 00000100:00100000:3.0:1789351174.230933:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1789351174.230934:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4a00/0xa6ea017771df6be4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6beb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351174.230944:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2bc2213050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+3:8411:x1876270626395520:12345-0@lo:104: 10000000:00010000:0.0:1789351174.230949:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4a00/0xa6ea017771df6be4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6beb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.230952:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2d02045200/0xa6ea017771df6b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6ba5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351174.230965:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789351174.230966:0:8411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351174.230992:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626395648 00010000:00010000:3.0:1789351174.230993:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789351174.230999:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626395648 00000100:00100000:3.0:1789351174.231000:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2bc2213050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+3:8411:x1876270626395520:12345-0@lo:104: Request processed in 58us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351174.231007:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1789351174.231010:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4a00/0xa6ea017771df6be4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6beb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351174.231019:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789351174.231029:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1789351174.231030:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d02044200/0xa6ea017771df6b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6b82 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.231039:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+3:8411:x1876270626395648:12345-0@lo:104: 00010000:00010000:1.0:1789351174.231039:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2d02044200/0xa6ea017771df6b89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6b82 expref: 18 pid: 5817 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351174.231041:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4a00/0xa6ea017771df6be4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6beb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.231048:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6b97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351174.231050:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626395776:0@lo:103: 00000100:00100000:1.0:1789351174.231056:0:8411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626395904:0@lo:104: 00010000:00010000:0.0:1789351174.231066:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4a00/0xa6ea017771df6be4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6beb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351174.231082:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789351174.231085:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2d02045200/0xa6ea017771df6b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6ba5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351174.231093:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789351174.231097:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02045200 already unused, calling callback (ffffffffc1cf8c20) 00000100:00100000:1.0:1789351174.231099:0:8411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789351174.231101:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:0.0:1789351174.231101:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2d02045200/0xa6ea017771df6b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6ba5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351174.231110:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2d02045200/0xa6ea017771df6b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6ba5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.231111:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+3:8411:x1876270626395648:12345-0@lo:104: Request processed in 72us (144us total) trans 0 rc 0/0 10000000:00010000:0.0:1789351174.231120:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2d02045200/0xa6ea017771df6b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6ba5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.231126:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 10000000:01000000:0.0:1789351174.231128:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789351174.231132:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d02045a00/0xa6ea017771df6b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b5a expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351174.231134:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626395776 00000100:00100000:3.0:1789351174.231139:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626395776 00000100:00100000:2.0:1789351174.231143:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626395904 00000100:00100000:2.0:1789351174.231147:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626395904 00010000:00010000:1.0:1789351174.231149:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2d02045a00/0xa6ea017771df6b4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b5a expref: 9 pid: 5814 timeout: 218 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351174.231157:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2d02045200/0xa6ea017771df6b9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6ba5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351174.231161:0:8411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626396032:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351174.231163:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ceecd9600/0xa6ea017771df6beb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6be4 expref: 19 pid: 5817 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.231169:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1789351174.231173:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789351174.231180:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+3:8411:x1876270626395904:12345-0@lo:104: 00010000:00010000:0.0:1789351174.231193:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2d02045200/0xa6ea017771df6b9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6ba5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.231196:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031c00/0xa6ea017771df6b82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6b89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351174.231200:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789351174.231203:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2d02045200/0xa6ea017771df6b9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6ba5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351174.231211:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc312e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3288:x1876270626395776:12345-0@lo:103: 00010000:00010000:0.0:1789351174.231225:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351174.231226:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351174.231228:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6b97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.231232:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ceecd9600/0xa6ea017771df6beb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6be4 expref: 19 pid: 5817 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351174.231236:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030c00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:0.0:1789351174.231241:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6b97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.231242:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789351174.231247:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ceecd9600/0xa6ea017771df6beb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6be4 expref: 19 pid: 5817 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.231255:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+3:8411:x1876270626395904:12345-0@lo:104: Request processed in 74us (158us total) trans 0 rc 0/0 00010000:00010000:0.0:1789351174.231256:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6b97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.231274:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 10000000:00010000:0.0:1789351174.231275:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6b97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351174.231282:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789351174.231286:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789351174.231305:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626396160:0@lo:103: 00010000:00010000:0.0:1789351174.231309:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6b90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6b97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351174.231313:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc312e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3288:x1876270626395776:12345-0@lo:103: Request processed in 103us (222us total) trans 0 rc 0/0 00010000:00010000:0.0:1789351174.231320:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789351174.231324:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789351174.231335:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6b90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6b97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.231336:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789351174.231344:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cd5931400/0xa6ea017771df6b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b53 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351174.231346:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6b90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6b97 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351174.231380:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626396160 00000100:00100000:3.0:1789351174.231383:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626396160 00010000:00010000:0.0:1789351174.231390:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351174.231394:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cc0031600/0xa6ea017771df6ba5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6b9e expref: 19 pid: 5814 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351174.231398:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031c00/0xa6ea017771df6b82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6b89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351174.231404:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031c00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:0.0:1789351174.231406:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031c00/0xa6ea017771df6b82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6b89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351174.231410:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031c00/0xa6ea017771df6b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6b89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789351174.231414:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031c00/0xa6ea017771df6b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6b89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351174.231418:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789351174.231437:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031c00/0xa6ea017771df6b82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6b89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351174.231442:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789351174.231446:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031c00/0xa6ea017771df6b82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6b89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351174.231451:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031c00/0xa6ea017771df6b82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6b89 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.231457:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626396288:0@lo:103: 00010000:00010000:0.0:1789351174.231472:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351174.231475:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351174.231478:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351174.231485:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789351174.231495:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1622300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3289:x1876270626396160:12345-0@lo:103: 00010000:00010000:3.0:1789351174.231503:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789351174.231505:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789351174.231510:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cc0031600/0xa6ea017771df6ba5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6b9e expref: 19 pid: 5814 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.231525:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789351174.231532:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626396544:0@lo:103: 00000100:00100000:2.0:1789351174.231560:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351174.231587:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626396288 00000100:00100000:2.0:1789351174.231590:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626396288 00010000:00010000:2.0:1789351174.231608:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6b97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6b90 expref: 20 pid: 5816 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.231619:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626396544 00000100:00100000:2.0:1789351174.231622:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626396544 00010000:00010000:2.0:1789351174.231630:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d02044200/0xa6ea017771df6b89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6b82 expref: 21 pid: 5817 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.231641:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789351174.231647:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1622680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+21:3286:x1876270626396288:12345-0@lo:103: 00010000:00010000:2.0:1789351174.231654:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351174.231658:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6b97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6b90 expref: 21 pid: 5816 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.231865:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2cd5931400/0xa6ea017771df6b43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b53 expref: 9 pid: 5816 timeout: 218 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351174.231874:0:8411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626396416:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351174.231904:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cc0031600/0xa6ea017771df6ba5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6b9e expref: 21 pid: 5814 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.231914:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789351174.231936:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d02044000/0xa6ea017771df6b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6b12 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351174.231942:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1622300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+21:3289:x1876270626396160:12345-0@lo:103: Request processed in 450us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351174.231949:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789351174.231957:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2d02044000/0xa6ea017771df6b19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6b12 expref: 21 pid: 5816 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351174.231964:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789351174.231972:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1622d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+20:3286:x1876270626396544:12345-0@lo:103: 00000100:00100000:1.0:1789351174.231974:0:8411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626396672:0@lo:104: 00010000:00010000:2.0:1789351174.231977:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6b97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6b90 expref: 20 pid: 5816 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.231980:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351174.231988:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d02044200/0xa6ea017771df6b89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6b82 expref: 20 pid: 5817 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.231993:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351174.232004:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d02044200/0xa6ea017771df6b89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6b82 expref: 20 pid: 5817 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.232012:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351174.232020:0:8411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351174.232032:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1622680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+20:3286:x1876270626396288:12345-0@lo:103: Request processed in 386us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351174.232040:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789351174.232045:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1622d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+20:3286:x1876270626396544:12345-0@lo:103: Request processed in 72us (485us total) trans 0 rc 0/0 00010000:00010000:1.0:1789351174.232050:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d02044400/0xa6ea017771df6aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6ae8 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351174.232054:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1789351174.232065:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2d02044400/0xa6ea017771df6aef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6ae8 expref: 19 pid: 5814 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351174.232074:0:8411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626396800:0@lo:104: 00000100:00100000:2.0:1789351174.232091:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626396544:0@lo:103: 00000100:00100000:3.0:1789351174.232098:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626395776:0@lo:103: 00000100:00100000:2.0:1789351174.232107:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626396288:0@lo:103: 00000100:00100000:1.0:1789351174.232111:0:8411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351174.232126:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626396160:0@lo:103: 00000100:00100000:2.0:1789351174.232135:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626396672 00000100:00100000:1.0:1789351174.232136:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626396800 00000100:00100000:2.0:1789351174.232140:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626396672 00000100:00100000:1.0:1789351174.232140:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626396800 00000100:00100000:2.0:1789351174.232163:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789351174.232171:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+4:8411:x1876270626396672:12345-0@lo:104: 00010000:00010000:2.0:1789351174.232179:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2d02045e00/0xa6ea017771df6b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6b19 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.232206:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351174.232212:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030800/0xa6ea017771df6bba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6bc1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.232218:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030800 already unused, calling callback (ffffffffc1cf8c20) 00010000:00010000:2.0:1789351174.232219:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:3.0:1789351174.232221:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030800/0xa6ea017771df6bba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6bc1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351174.232227:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789351174.232228:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+4:8411:x1876270626396672:12345-0@lo:104: Request processed in 58us (208us total) trans 0 rc 0/0 00010000:00010000:3.0:1789351174.232234:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030800/0xa6ea017771df6bba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6bc1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.232238:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789351174.232238:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f7166352-9951-4386-a0b0-6dc1f552d00a+4:8411:x1876270626396800:12345-0@lo:104: 10000000:00010000:3.0:1789351174.232247:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030800/0xa6ea017771df6bba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6bc1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351174.232251:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789351174.232252:0:7614:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2d02045800/0xa6ea017771df6ae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6aef expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.232255:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351174.232260:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2d02045e00/0xa6ea017771df6b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6b19 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.232267:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02045e00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:2.0:1789351174.232270:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2d02045e00/0xa6ea017771df6b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6b19 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.232271:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030800/0xa6ea017771df6bba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6bc1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.232276:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789351174.232285:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2d02045e00/0xa6ea017771df6b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6b19 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.232285:0:7614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789351174.232291:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f7166352-9951-4386-a0b0-6dc1f552d00a+3:8411:x1876270626396800:12345-0@lo:104: Request processed in 56us (181us total) trans 0 rc 0/0 00010000:00010000:3.0:1789351174.232292:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030800/0xa6ea017771df6bba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6bc1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789351174.232294:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2d02045e00/0xa6ea017771df6b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6b19 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351174.232302:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1789351174.232311:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030800/0xa6ea017771df6bba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6bc1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351174.232311:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789351174.232328:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789351174.232328:0:8411:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757bc00 going to sleep for 11 seconds 00010000:00010000:3.0:1789351174.232333:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2d02045800/0xa6ea017771df6ae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6aef expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.232343:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02045800 already unused, calling callback (ffffffffc1cf8c20) 00010000:00010000:2.0:1789351174.232343:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2d02045e00/0xa6ea017771df6b12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6b19 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.232345:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ceecd9600/0xa6ea017771df6beb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6be4 expref: 18 pid: 5817 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789351174.232351:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2d02045800/0xa6ea017771df6ae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6aef expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.232353:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789351174.232402:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2d02045800/0xa6ea017771df6ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6aef expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789351174.232408:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2d02045800/0xa6ea017771df6ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6aef expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351174.232413:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789351174.232433:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2d02045e00/0xa6ea017771df6b12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6b19 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.232439:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2d02045800/0xa6ea017771df6ae8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6aef expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.232442:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2d02045e00/0xa6ea017771df6b12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6b19 expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.232455:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789351174.232473:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351174.232477:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351174.232479:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351174.232482:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2d02045800/0xa6ea017771df6ae8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6aef expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.232489:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2d02045800/0xa6ea017771df6ae8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6aef expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.232503:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351174.232514:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351174.232517:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351174.232528:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626396928:0@lo:103: 00000100:00100000:3.0:1789351174.232554:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351174.232589:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789351174.232596:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626397056:0@lo:103: 00000100:00100000:1.0:1789351174.232605:0:8411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f67480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626395264:0@lo:104: 00000100:00100000:3.0:1789351174.232613:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351174.232634:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789351174.232640:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626397184:0@lo:103: 00000100:00100000:3.0:1789351174.232655:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351174.232670:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626396928 00000100:00100000:3.0:1789351174.232673:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626396928 00010000:00010000:3.0:1789351174.232689:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6bc1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6bba expref: 18 pid: 5816 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351174.232713:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626397056 00000100:00100000:3.0:1789351174.232717:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626397056 00000100:00100000:2.0:1789351174.232718:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626397184 00000100:00100000:2.0:1789351174.232724:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626397184 00010000:00010000:3.0:1789351174.232729:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d02044000/0xa6ea017771df6b19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6b12 expref: 20 pid: 5816 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.232743:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d02044400/0xa6ea017771df6aef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6ae8 expref: 20 pid: 5814 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351174.232746:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789351174.232755:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+20:3288:x1876270626396928:12345-0@lo:103: 00010000:00010000:3.0:1789351174.232762:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789351174.232764:0:8411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f66300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626395392:0@lo:104: 00010000:00010000:3.0:1789351174.232768:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6bc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6bba expref: 20 pid: 5816 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.232768:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1789351174.232779:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cc0031600/0xa6ea017771df6ba5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6b9e expref: 20 pid: 5814 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.232783:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6bc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6bba expref: 20 pid: 5816 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.232783:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+20:3288:x1876270626397056:12345-0@lo:103: 00010000:00010000:2.0:1789351174.232797:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351174.232802:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6bc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6bba expref: 19 pid: 5816 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.232804:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d02044000/0xa6ea017771df6b19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6b12 expref: 19 pid: 5816 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351174.232805:0:8411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626395520:0@lo:104: 00010000:00010000:1.0:1789351174.232816:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6b97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6b90 expref: 19 pid: 5816 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.232821:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d02044000/0xa6ea017771df6b19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6b12 expref: 19 pid: 5816 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351174.232823:0:8411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626395648:0@lo:104: 00010000:00010000:1.0:1789351174.232831:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d02044200/0xa6ea017771df6b89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6b82 expref: 18 pid: 5817 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.232832:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351174.232839:0:8411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626395904:0@lo:104: 00010000:00010000:1.0:1789351174.232847:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d02044000/0xa6ea017771df6b19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6b12 expref: 17 pid: 5816 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351174.232855:0:8411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626396672:0@lo:104: 00000100:00100000:1.0:1789351174.232863:0:8411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626396800:0@lo:104: 00000100:00100000:2.0:1789351174.232866:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+16:3288:x1876270626397056:12345-0@lo:103: Request processed in 88us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351174.232872:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789351174.232885:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789351174.232891:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+15:3287:x1876270626397184:12345-0@lo:103: 00010000:00010000:2.0:1789351174.232898:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351174.232903:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d02044400/0xa6ea017771df6aef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6ae8 expref: 15 pid: 5814 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.232911:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d02044400/0xa6ea017771df6aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6ae8 expref: 15 pid: 5814 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.232921:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d02044400/0xa6ea017771df6aef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6ae8 expref: 15 pid: 5814 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.232930:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789351174.232959:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:3287:x1876270626397184:12345-0@lo:103: Request processed in 67us (302us total) trans 0 rc 0/0 00010000:00010000:3.0:1789351174.232967:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789351174.232967:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789351174.232970:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626397184:0@lo:103: 00000100:00100000:3.0:1789351174.232992:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+12:3288:x1876270626396928:12345-0@lo:103: Request processed in 239us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351174.232997:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1789351174.233014:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351174.233015:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351174.233566:0:8411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626396032:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351174.234064:0:8411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8411:1876270626396416:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351174.234098:0:8411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6bf2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351174.234447:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626397056:0@lo:103: 00000100:00100000:0.0:1789351174.234459:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626396928:0@lo:103: 00000100:00100000:0.0:1789351174.234597:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351174.234641:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616940032 00000100:00100000:2.0:1789351174.234647:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616940032 00010000:00010000:2.0:1789351174.234669:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d02045a00/0xa6ea017771df6b4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b5a expref: 10 pid: 5814 timeout: 218 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351174.234699:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:2.0:1789351174.234714:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc312ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:2347:x1876270616940032:12345-192.168.201.52@tcp:103: 00010000:00010000:2.0:1789351174.234724:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351174.234730:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d02045a00/0xa6ea017771df6b4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b5a expref: 10 pid: 5814 timeout: 218 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.234740:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d02045a00/0xa6ea017771df6b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b5a expref: 10 pid: 5814 timeout: 218 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.234752:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d02045a00/0xa6ea017771df6b4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b5a expref: 10 pid: 5814 timeout: 218 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351174.234762:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789351174.234804:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc312ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:2347:x1876270616940032:12345-192.168.201.52@tcp:103: Request processed in 92us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351174.234812:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:1.0:1789351174.235277:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351174.235346:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616940160 00000100:00100000:3.0:1789351174.235351:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616940160 00010000:00010000:3.0:1789351174.235405:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cd5931400/0xa6ea017771df6b43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b53 expref: 9 pid: 5816 timeout: 218 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351174.235438:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:3.0:1789351174.235596:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:2347:x1876270616940160:12345-192.168.201.52@tcp:103: 00010000:00010000:3.0:1789351174.235604:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351174.235609:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cd5931400/0xa6ea017771df6b43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b53 expref: 9 pid: 5816 timeout: 218 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.235618:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cd5931400/0xa6ea017771df6b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b53 expref: 9 pid: 5816 timeout: 218 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.235629:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cd5931400/0xa6ea017771df6b43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b53 expref: 9 pid: 5816 timeout: 218 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.235641:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6bf2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.235656:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6bf2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.235669:0:6676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6bf2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.235676:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6bf2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.235683:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6bf2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.235690:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6bf2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.235696:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cd5931800 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351174.235700:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6bf2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.235707:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6bf2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.235732:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6bf2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351174.235742:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351174.235794:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:038b9b38-b2ec-45ac-958b-dad437feb5c7+8:2347:x1876270616940160:12345-192.168.201.52@tcp:103: Request processed in 201us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351174.235802:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00010000:00010000:1.0:1789351174.235862:0:8411:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6bf2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.235870:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6bf2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351174.235876:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6bf2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1789351174.342200:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8237986d-b9e8-417a-ac8f-a078390d268c 00000100:00100000:3.0:1789351174.570990:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351174.571055:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351174.571082:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351174.571531:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616940416 00000100:00100000:0.0:1789351174.571541:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616940416 00000100:00100000:1.0:1789351174.571650:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616940544 00000100:00100000:1.0:1789351174.571656:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616940544 00000100:00100000:0.0:1789351174.571713:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:2.0:1789351174.571723:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616940288 00000100:00100000:0.0:1789351174.571726:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:2348:x1876270616940416:12345-192.168.201.52@tcp:400: 00000100:00100000:2.0:1789351174.571729:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616940288 00000100:00100000:0.0:1789351174.571802:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:2348:x1876270616940416:12345-192.168.201.52@tcp:400: Request processed in 79us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351174.571808:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00080000:3.0:1789351174.572120:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789351174.572126:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789351174.572128:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789351174.573810:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:1.0:1789351174.573825:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+5:2348:x1876270616940544:12345-192.168.201.52@tcp:400: 00000100:00100000:1.0:1789351174.573902:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+5:2348:x1876270616940544:12345-192.168.201.52@tcp:400: Request processed in 81us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351174.573909:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:2.0:1789351174.574037:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:2.0:1789351174.574047:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+6:2348:x1876270616940288:12345-192.168.201.52@tcp:400: 00000100:00100000:2.0:1789351174.574077:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+6:2348:x1876270616940288:12345-192.168.201.52@tcp:400: Request processed in 33us (3021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351174.574085:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1789351174.818531:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876270626397568:0@lo:400: 00000100:00100000:3.0:1789351174.818605:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351174.818670:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789351174.818677:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876270626397440:0@lo:400: 00000100:00100000:3.0:1789351174.818700:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351174.818720:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626397952:0@lo:400: 00000100:00100000:3.0:1789351174.818749:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351174.818782:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626397568 00000100:00100000:3.0:1789351174.818789:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626397568 00000100:00100000:3.0:1789351174.818837:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626397440 00000100:00100000:3.0:1789351174.818841:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626397440 00000100:00100000:3.0:1789351174.818856:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789351174.818866:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876270626397568:12345-0@lo:400: 00000100:00100000:3.0:1789351174.818916:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876270626397568:12345-0@lo:400: Request processed in 51us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351174.818923:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789351174.818939:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789351174.818945:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876270626397440:12345-0@lo:400: 00000100:00100000:3.0:1789351174.818972:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876270626397440:12345-0@lo:400: Request processed in 27us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351174.818977:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789351174.819012:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876270626397440:0@lo:400: 00000100:00100000:3.0:1789351174.819043:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876270626397568:0@lo:400: 00000100:00080000:3.0:1789351174.819066:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789351174.819180:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626397312:0@lo:400: 00000100:00100000:1.0:1789351174.819217:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351174.819255:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876270626397824:0@lo:400: 00000100:00100000:1.0:1789351174.819277:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351174.819296:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789351174.819301:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626397696:0@lo:400: 00000100:00100000:1.0:1789351174.819323:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351174.819347:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626397824 00000100:00100000:1.0:1789351174.819351:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626397824 00000100:00100000:1.0:1789351174.819404:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789351174.819411:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876270626397824:12345-0@lo:400: 00000100:00100000:1.0:1789351174.819446:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876270626397824:12345-0@lo:400: Request processed in 36us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351174.819463:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789351174.819490:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876270626397824:0@lo:400: 00000100:00100000:0.0:1789351174.822232:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789351174.822254:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626398080:0@lo:13: 00000100:00100000:0.0:1789351174.822316:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351174.822379:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626397952 00000100:00100000:0.0:1789351174.822385:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626397952 00000100:00100000:0.0:1789351174.822423:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626397696 00000100:00100000:0.0:1789351174.822427:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626397696 00000100:00100000:0.0:1789351174.822447:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789351174.822470:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3289:x1876270626397952:12345-0@lo:400: 00000100:00100000:0.0:1789351174.822516:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3289:x1876270626397952:12345-0@lo:400: Request processed in 61us (3766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351174.822523:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789351174.822538:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789351174.822544:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626397696:12345-0@lo:400: 00000100:00100000:0.0:1789351174.822575:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626397696:12345-0@lo:400: Request processed in 31us (3250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351174.822580:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789351174.823407:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626398080 00000100:00100000:1.0:1789351174.823420:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626398080 00000100:00100000:1.0:1789351174.823462:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789351174.823470:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626398080:12345-0@lo:13: 00002000:00000024:1.0:1789351174.823496:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789351174.823546:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626398080:12345-0@lo:13: Request processed in 76us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351174.823552:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789351174.823591:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cffa11880 x1876270626398080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351174.823609:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626398080:0@lo:13: 00010000:00080000:1.0:1789351174.823641:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf772ca80 x1876270626397696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351174.823651:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626397696:0@lo:400: 00000100:00100000:3.0:1789351174.824185:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626397312 00000100:00100000:3.0:1789351174.824190:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626397312 00000100:00100000:3.0:1789351174.824233:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789351174.824241:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+12:3287:x1876270626397312:12345-0@lo:400: 00000100:00100000:3.0:1789351174.824289:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+12:3287:x1876270626397312:12345-0@lo:400: Request processed in 49us (5071us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351174.824295:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789351174.824342:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626397312:0@lo:400: 00000100:00080000:3.0:1789351174.824381:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789351174.824386:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789351174.824389:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789351174.824641:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf95fd880 x1876270626397952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351174.824652:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626397952:0@lo:400: 00000001:00080000:1.0:1789351174.892649:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1789351175.137509:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351176.161745:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351176.942718:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351176.942940:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616940672 00000100:00100000:2.0:1789351176.942963:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616940672 00000100:00100000:2.0:1789351176.943026:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 123 00000100:00100000:2.0:1789351176.943037:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+8:5583:x1876270616940672:12345-192.168.201.52@tcp:101: 00010000:00010000:2.0:1789351176.943054:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351176.943076:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cf0f79a00/0xa6ea017771df6bf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7bbc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351176.943105:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cf0f79a00/0xa6ea017771df6bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bbc expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351176.943116:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cf0f79a00/0xa6ea017771df6bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bbc expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351176.943125:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cf0f79a00, rc 0) 00000100:00100000:2.0:1789351176.943188:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:5583:x1876270616940672:12345-192.168.201.52@tcp:101: Request processed in 153us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351176.943196:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 123 00000100:00100000:0.0:1789351176.953160:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351176.953388:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616940800 00000100:00100000:1.0:1789351176.953399:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616940800 00000100:00100000:1.0:1789351176.953468:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 124 00000100:00100000:1.0:1789351176.953480:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:5583:x1876270616940800:12345-192.168.201.52@tcp:501: 00000100:00100000:1.0:1789351176.953790:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:5583:x1876270616940800:12345-192.168.201.52@tcp:501: Request processed in 311us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351176.953798:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 124 00000100:00100000:0.0:1789351176.960131:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351176.960473:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616940928 00000100:00100000:3.0:1789351176.960484:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616940928 00000100:00100000:3.0:1789351176.960545:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 125 00000100:00100000:3.0:1789351176.960556:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ce9d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:5583:x1876270616940928:12345-192.168.201.52@tcp:503: 00000100:00100000:3.0:1789351176.960802:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ce9d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:5583:x1876270616940928:12345-192.168.201.52@tcp:503: Request processed in 247us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351176.960811:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 125 00000100:00100000:3.0:1789351176.965449:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351176.965690:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616941056 00000100:00100000:2.0:1789351176.965700:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616941056 00000100:00100000:2.0:1789351176.965751:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:2.0:1789351176.965762:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ce9d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:6062:x1876270616941056:12345-192.168.201.52@tcp:502: 00000100:00100000:2.0:1789351176.966047:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ce9d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:6062:x1876270616941056:12345-192.168.201.52@tcp:502: Request processed in 285us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351176.966055:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:0.0:1789351176.968951:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351176.971683:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616941184 00000100:00100000:1.0:1789351176.971695:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616941184 00000100:00100000:1.0:1789351176.971750:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 127 00000100:00100000:1.0:1789351176.971757:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ce9d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:6062:x1876270616941184:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789351176.972185:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ce9d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:6062:x1876270616941184:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 426us (3242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351176.972191:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 127 00000100:00100000:0.0:1789351176.977405:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351176.977481:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616941312 00000100:00100000:2.0:1789351176.977492:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616941312 00000100:00100000:2.0:1789351176.977538:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 128 00000100:00100000:2.0:1789351176.977547:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:5583:x1876270616941312:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789351176.977573:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351176.977589:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cf0f78200/0xa6ea017771df6c00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7bc3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351176.977615:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cf0f78200/0xa6ea017771df6c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bc3 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351176.977627:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cf0f78200/0xa6ea017771df6c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bc3 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351176.977636:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cf0f78200, rc 0) 00000100:00100000:2.0:1789351176.977697:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5583:x1876270616941312:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 152us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351176.977704:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 128 00000100:00100000:0.0:1789351176.982939:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351176.983033:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616941440 00000100:00100000:3.0:1789351176.983043:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616941440 00000100:00100000:3.0:1789351176.983102:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 129 00000100:00100000:3.0:1789351176.983113:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5583:x1876270616941440:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789351176.983428:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5583:x1876270616941440:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 305us (487us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789351176.983438:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 129 00010000:00010000:3.0:1789351177.185623:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789351177.862383:0:8467:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcdff33b30 20000000:00000080:1.0:1789351177.862401:0:8467:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2cc6fdbc00 uarg=0000000000000000 20000000:01000000:1.0:1789351177.862876:0:8467:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789351177.862881:0:8467:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789351177.862886:0:8467:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789351177.863759:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789351177.863874:0:8467:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789351177.866979:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789351177.867027:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789351177.867071:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789351177.867085:0:8467:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789351177.867104:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c07 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351177.867122:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d021c5c00/0xa6ea017771df6a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6a2b expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351177.867129:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d021c5e00/0xa6ea017771df6aa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6aa2 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351177.867136:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d02044c00/0xa6ea017771df6b0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6b04 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351177.867145:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cc0031400/0xa6ea017771df6b58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b8b expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351177.867153:0:8467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c07 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351177.867196:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cc0031400/0xa6ea017771df6b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b8b expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351177.867210:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2cc0031400/0xa6ea017771df6b58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b8b expref: 9 pid: 5814 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351177.867224:0:8467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1876270626398208:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351177.867322:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d02044c00/0xa6ea017771df6b0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6b04 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351177.867330:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2d02044c00/0xa6ea017771df6b0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6b04 expref: 11 pid: 5814 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351177.867339:0:8467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1876270626398336:0@lo:104: 00000100:00100000:1.0:1789351177.867431:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789351177.867468:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d021c5e00/0xa6ea017771df6aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6aa2 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351177.867476:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2d021c5e00/0xa6ea017771df6aa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6aa2 expref: 11 pid: 5814 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351177.867485:0:8467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1876270626398464:0@lo:104: 00000100:00100000:1.0:1789351177.867508:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351177.867541:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626398336 00000100:00100000:1.0:1789351177.867547:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626398336 00000100:00100000:1.0:1789351177.867583:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626398464 00000100:00100000:1.0:1789351177.867586:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626398464 00000100:00100000:1.0:1789351177.867604:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789351177.867613:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f7166352-9951-4386-a0b0-6dc1f552d00a+4:8467:x1876270626398336:12345-0@lo:104: 00010000:00010000:1.0:1789351177.867630:0:7614:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6b04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6b0b expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351177.867679:0:7614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789351177.867686:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f7166352-9951-4386-a0b0-6dc1f552d00a+4:8467:x1876270626398336:12345-0@lo:104: Request processed in 74us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351177.867694:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789351177.867712:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789351177.867745:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+3:8467:x1876270626398464:12345-0@lo:104: 00010000:00010000:3.0:1789351177.867766:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5800/0xa6ea017771df6aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6aa9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351177.867857:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789351177.867868:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+3:8467:x1876270626398464:12345-0@lo:104: Request processed in 136us (356us total) trans 0 rc 0/0 00010000:00010000:2.0:1789351177.867989:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789351177.867997:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6b04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6b0b expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351177.868005:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031200 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:2.0:1789351177.868009:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6b04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6b0b expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351177.868017:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6b04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6b0b expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789351177.868023:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6b04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6b0b expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351177.868029:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789351177.868069:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6b04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6b0b expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351177.868076:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789351177.868100:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6b04 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6b0b expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351177.868108:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031200/0xa6ea017771df6b04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6b0b expref: -99 pid: 7600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351177.868121:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351177.868125:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5800/0xa6ea017771df6aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6aa9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351177.868130:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c5800 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:2.0:1789351177.868133:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5800/0xa6ea017771df6aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6aa9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351177.868140:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5800/0xa6ea017771df6aa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6aa9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789351177.868146:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5800/0xa6ea017771df6aa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6aa9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351177.868151:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789351177.868164:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5800/0xa6ea017771df6aa2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6aa9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351177.868170:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789351177.868174:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5800/0xa6ea017771df6aa2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6aa9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351177.868220:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626398592:0@lo:103: 00000100:00100000:0.0:1789351177.868253:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351177.868277:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789351177.868284:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626398720:0@lo:103: 00000100:00100000:0.0:1789351177.868305:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351177.868330:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626398592 00000100:00100000:0.0:1789351177.868334:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626398592 00010000:00010000:0.0:1789351177.868354:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d02044c00/0xa6ea017771df6b0b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6b04 expref: 12 pid: 5814 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351177.868399:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626398720 00000100:00100000:0.0:1789351177.868402:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626398720 00010000:00010000:0.0:1789351177.868427:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d021c5e00/0xa6ea017771df6aa9 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6aa2 expref: 13 pid: 5814 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351177.868446:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789351177.868454:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:3286:x1876270626398592:12345-0@lo:103: 00010000:00010000:0.0:1789351177.868464:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351177.868469:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d02044c00/0xa6ea017771df6b0b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6b04 expref: 13 pid: 5814 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351177.868478:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d02044c00/0xa6ea017771df6b0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6b04 expref: 13 pid: 5814 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351177.868493:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351177.868524:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:3286:x1876270626398592:12345-0@lo:103: Request processed in 71us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351177.868530:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789351177.868552:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789351177.868574:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+12:3286:x1876270626398720:12345-0@lo:103: 00010000:00010000:0.0:1789351177.868582:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351177.868586:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d021c5e00/0xa6ea017771df6aa9 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6aa2 expref: 12 pid: 5814 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351177.868595:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d021c5e00/0xa6ea017771df6aa9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6aa2 expref: 12 pid: 5814 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351177.868605:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351177.868627:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+12:3286:x1876270626398720:12345-0@lo:103: Request processed in 57us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351177.868633:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789351177.868719:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5800/0xa6ea017771df6aa2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6aa9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351177.868730:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351177.868732:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351177.868734:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351177.868769:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351177.870578:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626398720:0@lo:103: 00000100:00100000:0.0:1789351177.870598:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626398592:0@lo:103: 00000100:00100000:3.0:1789351177.870771:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1789351177.870815:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d021c5c00/0xa6ea017771df6a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6a2b expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351177.870831:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2d021c5c00/0xa6ea017771df6a32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6a2b expref: 11 pid: 5814 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351177.870845:0:8467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1876270626398848:0@lo:104: 00000100:00100000:1.0:1789351177.870891:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351177.870925:0:8467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc60c2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789351177.870939:0:8467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1876270626398208:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351177.870948:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d02044c00/0xa6ea017771df6b0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6b04 expref: 11 pid: 5814 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351177.870962:0:8467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1876270626398336:0@lo:104: 00010000:00010000:1.0:1789351177.870971:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d021c5e00/0xa6ea017771df6aa9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6aa2 expref: 10 pid: 5814 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351177.870980:0:8467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1876270626398464:0@lo:104: 00000100:00100000:0.0:1789351177.871607:0:8416:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789351177.871621:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626398848 00000100:00100000:0.0:1789351177.871626:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626398848 00000100:00100000:0.0:1789351177.871702:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789351177.871711:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2bc2519c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:f7166352-9951-4386-a0b0-6dc1f552d00a+3:8467:x1876270626398848:12345-0@lo:104: 00010000:00010000:0.0:1789351177.871721:0:8416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030e00/0xa6ea017771df6a2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6a32 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351177.871775:0:8416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789351177.871782:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2bc2519c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:f7166352-9951-4386-a0b0-6dc1f552d00a+3:8467:x1876270626398848:12345-0@lo:104: Request processed in 72us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351177.871789:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1789351177.871817:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351177.871827:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030e00/0xa6ea017771df6a2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6a32 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351177.871836:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030e00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:3.0:1789351177.871840:0:8417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030e00/0xa6ea017771df6a2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6a32 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351177.871849:0:8417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030e00/0xa6ea017771df6a2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6a32 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789351177.871855:0:8417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030e00/0xa6ea017771df6a2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6a32 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351177.871880:0:8417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789351177.871897:0:8467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1876270626398848:0@lo:104: 00010000:00010000:1.0:1789351177.871922:0:8467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c07 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351177.871933:0:8417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030e00/0xa6ea017771df6a2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a32 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351177.871966:0:8417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789351177.871999:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030e00/0xa6ea017771df6a2b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a32 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351177.872007:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626398976:0@lo:103: 00010000:00010000:3.0:1789351177.872019:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030e00/0xa6ea017771df6a2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6a32 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351177.872046:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789351177.872051:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351177.872055:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351177.872058:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351177.872494:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351177.872601:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626398976 00000100:00100000:3.0:1789351177.872610:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626398976 00010000:00010000:3.0:1789351177.872647:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d021c5c00/0xa6ea017771df6a32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6a2b expref: 10 pid: 5814 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351177.872655:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616941568 00000100:00100000:0.0:1789351177.872668:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616941568 00000100:00100000:3.0:1789351177.872689:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789351177.872701:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+10:3288:x1876270626398976:12345-0@lo:103: 00010000:00010000:3.0:1789351177.872714:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351177.872721:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d021c5c00/0xa6ea017771df6a32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6a2b expref: 10 pid: 5814 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351177.872732:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d021c5c00/0xa6ea017771df6a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6a2b expref: 10 pid: 5814 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351177.872748:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d021c5c00/0xa6ea017771df6a32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6a2b expref: 10 pid: 5814 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351177.872770:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cc0031400/0xa6ea017771df6b58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b8b expref: 10 pid: 5814 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351177.872776:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351177.872828:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:0.0:1789351177.872837:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:2348:x1876270616941568:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351177.872847:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351177.872856:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cc0031400/0xa6ea017771df6b58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b8b expref: 10 pid: 5814 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351177.872867:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cc0031400/0xa6ea017771df6b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b8b expref: 10 pid: 5814 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351177.872884:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cc0031400/0xa6ea017771df6b58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b8b expref: 10 pid: 5814 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351177.872897:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c07 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351177.872904:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c07 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351177.872917:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c07 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351177.872922:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+9:3288:x1876270626398976:12345-0@lo:103: Request processed in 218us (873us total) trans 0 rc 0/0 00010000:00010000:0.0:1789351177.872932:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c07 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351177.872944:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1789351177.872947:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c07 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351177.872964:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c07 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351177.872975:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cd5931800 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351177.872979:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c07 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351177.872987:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c07 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351177.873006:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626398976:0@lo:103: 00010000:00010000:0.0:1789351177.873006:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c07 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351177.873030:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351177.873078:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:2348:x1876270616941568:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 241us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351177.873086:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00010000:00010000:1.0:1789351177.873127:0:8467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c07 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351177.873135:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c07 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351177.873141:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c07 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351177.890482:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789351177.890508:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626399104:0@lo:13: 00000100:00100000:2.0:1789351177.890573:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351177.890611:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626399104 00000100:00100000:3.0:1789351177.890621:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626399104 00000100:00100000:3.0:1789351177.890729:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789351177.890738:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626399104:12345-0@lo:13: 00002000:00000024:3.0:1789351177.890770:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789351177.890827:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626399104:12345-0@lo:13: Request processed in 89us (253us total) trans 0 rc 0/0 00010000:00080000:2.0:1789351177.890862:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc31d2680 x1876270626399104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351177.890882:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626399104:0@lo:13: 00000100:00100000:3.0:1789351177.890888:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789351177.890915:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789351178.057800:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351178.058195:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616941696 00000100:00100000:1.0:1789351178.058211:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616941696 00000100:00100000:1.0:1789351178.058275:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 130 00000100:00100000:1.0:1789351178.058295:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8338050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+9:5583:x1876270616941696:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789351178.058311:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351178.058331:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7bca expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351178.058386:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bca expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351178.058397:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bca expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351178.058419:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cd5931800, rc 0) 00000100:00100000:1.0:1789351178.058492:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8338050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5583:x1876270616941696:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 208us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351178.058508:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 130 00000100:00100000:3.0:1789351178.062881:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351178.063418:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616941824 00000100:00100000:0.0:1789351178.063429:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616941824 00000100:00100000:0.0:1789351178.063482:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 131 00000100:00100000:0.0:1789351178.063491:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8339450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5583:x1876270616941824:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351178.063737:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8339450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5583:x1876270616941824:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 246us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351178.063745:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 131 00000100:00100000:3.0:1789351178.065472:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351178.065638:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616941952 00000100:00100000:1.0:1789351178.065646:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616941952 00000100:00100000:1.0:1789351178.065692:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 132 00000100:00100000:1.0:1789351178.065701:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5583:x1876270616941952:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351178.066000:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:5583:x1876270616941952:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 299us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351178.066009:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 132 00000100:00100000:1.0:1789351178.068035:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351178.068149:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616942080 00000100:00100000:3.0:1789351178.068157:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616942080 00000100:00100000:3.0:1789351178.068249:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 133 00000100:00100000:3.0:1789351178.068259:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:6119:x1876270616942080:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789351178.068482:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:6119:x1876270616942080:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 224us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351178.068490:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 133 00000100:00100000:0.0:1789351178.073720:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351178.073807:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616942208 00000100:00100000:1.0:1789351178.073817:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616942208 00000100:00100000:1.0:1789351178.073962:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 134 00000100:00100000:1.0:1789351178.073973:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:6119:x1876270616942208:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789351178.074192:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:6119:x1876270616942208:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 221us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351178.074201:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 134 00010000:00010000:2.0:1789351178.210986:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351179.233533:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351179.689911:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351179.690198:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351179.690236:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351179.690271:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351179.690300:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616942336 00000100:00100000:3.0:1789351179.690309:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616942336 00000100:00100000:3.0:1789351179.690431:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 135 00000100:00100000:3.0:1789351179.690441:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:2350:x1876270616942336:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351179.690515:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:2350:x1876270616942336:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 75us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351179.690523:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 135 00000100:00100000:3.0:1789351179.690649:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616942720 00000100:00100000:3.0:1789351179.690654:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616942720 00000100:00100000:3.0:1789351179.690686:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616942592 00000100:00100000:3.0:1789351179.690689:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616942592 00000100:00100000:3.0:1789351179.690706:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:3.0:1789351179.690712:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:2350:x1876270616942720:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351179.690744:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:2350:x1876270616942720:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 32us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351179.690750:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:3.0:1789351179.690762:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:3.0:1789351179.690768:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:2350:x1876270616942592:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351179.690791:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:2350:x1876270616942592:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 23us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351179.690797:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00080000:3.0:1789351179.690813:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789351179.690817:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789351179.692827:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616942464 00000100:00100000:0.0:1789351179.692835:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616942464 00000100:00100000:1.0:1789351179.692975:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:1.0:1789351179.692988:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+6:2350:x1876270616942464:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789351179.693050:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+6:2350:x1876270616942464:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 66us (3151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.693057:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00080000:2.0:1789351179.693722:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1789351179.746433:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789351179.746442:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d2cc5aa8000 from 39 10000000:01000000:3.0:1789351179.746447:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789351179.746496:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351179.746508:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351179.746519:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351179.746542:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626399232:0@lo:101: 00000100:00100000:3.0:1789351179.746610:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351179.746664:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0788780 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.746873:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626399232 00000100:00100000:1.0:1789351179.746882:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626399232 00000100:00100000:1.0:1789351179.746938:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789351179.746955:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+9:5820:x1876270626399232:12345-0@lo:101: 00010000:00010000:1.0:1789351179.746971:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351179.746984:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cd5930800/0xa6ea017771df6c1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6c15 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.747010:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cd5930800/0xa6ea017771df6c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6c15 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.747021:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cd5930800/0xa6ea017771df6c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6c15 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.747030:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cd5930800, rc 0) 00000100:00100000:1.0:1789351179.747082:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+10:5820:x1876270626399232:12345-0@lo:101: Request processed in 128us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.747090:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789351179.747123:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626399232:0@lo:101: 00010000:00010000:3.0:1789351179.747138:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c1c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351179.747147:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6c1c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351179.747199:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626399360:0@lo:501: 00000100:00100000:3.0:1789351179.747225:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351179.747254:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0788780 going to sleep for 11 seconds 00000100:00100000:0.0:1789351179.747302:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626399360 00000100:00100000:0.0:1789351179.747306:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626399360 00000100:00100000:0.0:1789351179.747339:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789351179.747346:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:5820:x1876270626399360:12345-0@lo:501: 00000100:00100000:0.0:1789351179.747620:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:5820:x1876270626399360:12345-0@lo:501: Request processed in 274us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351179.747628:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789351179.752166:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626399360:0@lo:501: 00000100:00100000:1.0:1789351179.752231:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626399488:0@lo:503: 00000100:00100000:1.0:1789351179.752307:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.752387:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cffa71000 going to sleep for 11 seconds 00000100:00100000:3.0:1789351179.752512:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626399488 00000100:00100000:3.0:1789351179.752519:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626399488 00000100:00100000:3.0:1789351179.752562:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789351179.752572:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+10:5820:x1876270626399488:12345-0@lo:503: 00000100:00100000:3.0:1789351179.752780:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+10:5820:x1876270626399488:12345-0@lo:503: Request processed in 209us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351179.752788:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789351179.753009:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626399488:0@lo:503: 00000100:00100000:0.0:1789351179.756292:0:8592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8592:1876270626399616:0@lo:502: 00000100:00100000:0.0:1789351179.756415:0:8592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351179.756455:0:8592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6eb39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351179.756511:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626399616 00000100:00100000:3.0:1789351179.756518:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626399616 00000100:00100000:3.0:1789351179.756566:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789351179.756575:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8339c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+10:8592:x1876270626399616:12345-0@lo:502: 00000100:00100000:3.0:1789351179.756811:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8339c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+10:8592:x1876270626399616:12345-0@lo:502: Request processed in 236us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351179.756818:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789351179.757063:0:8592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8592:1876270626399616:0@lo:502: 00000100:00100000:2.0:1789351179.757108:0:8592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8592:1876270626399744:0@lo:502: 00000100:00100000:2.0:1789351179.757144:0:8592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351179.757175:0:8592:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc65cec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.757392:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626399744 00000100:00100000:1.0:1789351179.757397:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626399744 00000100:00100000:1.0:1789351179.757423:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789351179.757429:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8338c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:8592:x1876270626399744:12345-0@lo:502: 00000100:00100000:1.0:1789351179.757570:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8338c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+10:8592:x1876270626399744:12345-0@lo:502: Request processed in 140us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.757577:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789351179.757773:0:8592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8592:1876270626399744:0@lo:502: 00000040:00080000:2.0:1789351179.757792:0:8592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789351179.761620:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789351179.761657:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789351179.761670:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c1c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351179.761682:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c1c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351179.761692:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789351179.761695:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789351179.761697:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789351179.761733:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351179.761741:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351179.761752:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351179.761775:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626399872:0@lo:101: 00000100:00100000:3.0:1789351179.761841:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351179.761931:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0788540 going to sleep for 11 seconds 00000100:00100000:2.0:1789351179.762069:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626399872 00000100:00100000:2.0:1789351179.762077:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626399872 00000100:00100000:2.0:1789351179.762136:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789351179.762145:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+10:5820:x1876270626399872:12345-0@lo:101: 00010000:00010000:2.0:1789351179.762157:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351179.762169:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cf0f78a00/0xa6ea017771df6c2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6c23 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351179.762191:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cf0f78a00/0xa6ea017771df6c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6c23 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351179.762201:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cf0f78a00/0xa6ea017771df6c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6c23 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351179.762210:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cf0f78a00, rc 0) 00000100:00100000:2.0:1789351179.762251:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+11:5820:x1876270626399872:12345-0@lo:101: Request processed in 108us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351179.762258:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789351179.762304:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626399872:0@lo:101: 00010000:00010000:2.0:1789351179.762316:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c2a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351179.762324:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6c2a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351179.762411:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626400000:0@lo:501: 00000100:00100000:2.0:1789351179.762438:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351179.762459:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc65cea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789351179.762471:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626400000 00000100:00100000:2.0:1789351179.762474:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626400000 00000100:00100000:2.0:1789351179.762495:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789351179.762509:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:5820:x1876270626400000:12345-0@lo:501: 00000100:00100000:2.0:1789351179.762743:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:5820:x1876270626400000:12345-0@lo:501: Request processed in 235us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351179.762750:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789351179.762780:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626400000:0@lo:501: 00000100:00100000:2.0:1789351179.762807:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626400128:0@lo:503: 00000100:00100000:2.0:1789351179.762842:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351179.762856:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc65cea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789351179.762866:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626400128 00000100:00100000:2.0:1789351179.762870:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626400128 00000100:00100000:2.0:1789351179.762889:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789351179.762896:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:5820:x1876270626400128:12345-0@lo:503: 00000100:00100000:2.0:1789351179.763038:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:5820:x1876270626400128:12345-0@lo:503: Request processed in 140us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351179.763044:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789351179.763077:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626400128:0@lo:503: 00000100:00100000:1.0:1789351179.763558:0:8594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8594:1876270626400256:0@lo:502: 00000100:00100000:1.0:1789351179.763595:0:8594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.763622:0:8594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941540 going to sleep for 11 seconds 00000100:00100000:2.0:1789351179.763656:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626400256 00000100:00100000:2.0:1789351179.763660:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626400256 00000100:00100000:2.0:1789351179.763681:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789351179.763687:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:8594:x1876270626400256:12345-0@lo:502: 00000100:00100000:2.0:1789351179.763851:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+11:8594:x1876270626400256:12345-0@lo:502: Request processed in 164us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351179.763859:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789351179.765033:0:8594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8594:1876270626400256:0@lo:502: 00000020:01000000:1.0:1789351179.765064:0:8594:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789351179.765073:0:8594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351179.765075:0:8594:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789351179.765080:0:8594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789351179.765107:0:8594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8594:1876270626400384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351179.765155:0:8594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.765226:0:8594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941540 going to sleep for 11 seconds 00000100:00100000:2.0:1789351179.765742:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626400384 00000100:00100000:2.0:1789351179.765749:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626400384 00000100:00100000:0.0:1789351179.765864:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789351179.765875:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+11:8594:x1876270626400384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789351179.766085:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+11:8594:x1876270626400384:12345-0@lo:502:llog_process_th.0 Request processed in 212us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351179.766092:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789351179.768233:0:8594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8594:1876270626400384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789351179.768275:0:8594:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789351179.768283:0:8594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351179.768285:0:8594:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789351179.768289:0:8594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789351179.772465:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789351179.772500:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789351179.772512:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c2a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.772525:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c2a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351179.772535:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789351179.772537:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2cc5aa8000 from 4 10000000:01000000:1.0:1789351179.772540:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789351179.772579:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931e00/0xa6ea017771df6c31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.772598:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931e00/0xa6ea017771df6c31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.772610:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931e00/0xa6ea017771df6c31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351179.772639:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626400512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.772710:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.772763:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941540 going to sleep for 11 seconds 00000100:00100000:0.0:1789351179.772866:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626400512 00000100:00100000:0.0:1789351179.772874:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626400512 00000100:00100000:0.0:1789351179.772919:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789351179.772929:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+11:5820:x1876270626400512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789351179.772942:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351179.772955:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecd9400/0xa6ea017771df6c38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6c31 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.772978:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecd9400/0xa6ea017771df6c38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6c31 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.772990:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecd9400/0xa6ea017771df6c38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6c31 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.773008:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9400, rc 0) 00000100:00100000:0.0:1789351179.773050:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5820:x1876270626400512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351179.773057:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789351179.773554:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626400512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789351179.773570:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931e00/0xa6ea017771df6c31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c38 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.773580:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931e00/0xa6ea017771df6c31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6c38 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351179.773632:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626400640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.773662:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.773688:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941540 going to sleep for 11 seconds 00000100:00100000:0.0:1789351179.773743:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626400640 00000100:00100000:0.0:1789351179.773748:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626400640 00000100:00100000:0.0:1789351179.773809:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789351179.773817:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5820:x1876270626400640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351179.774046:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5820:x1876270626400640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351179.774054:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789351179.774715:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626400640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.774751:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626400768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.774793:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.774819:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941540 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.774832:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626400768 00000100:00100000:1.0:1789351179.774837:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626400768 00000100:00100000:1.0:1789351179.774870:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789351179.774877:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5820:x1876270626400768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.775029:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5820:x1876270626400768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.775037:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789351179.775075:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626400768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.775246:0:8596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8596:1876270626400896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351179.775281:0:8596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.775300:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626400896 00000100:00100000:1.0:1789351179.775304:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626400896 00000100:00100000:1.0:1789351179.775326:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789351179.775333:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+12:8596:x1876270626400896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351179.775481:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+12:8596:x1876270626400896:12345-0@lo:502:llog_process_th.0 Request processed in 149us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.775488:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789351179.775516:0:8596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941240 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.775527:0:8596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8596:1876270626400896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789351179.775548:0:8596:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789351179.775557:0:8596:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351179.775559:0:8596:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789351179.775565:0:8596:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2cc5aa8000 00000020:00000080:1.0:1789351179.775568:0:8596:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789351179.775632:0:8596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8596:1876270626401024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351179.775664:0:8596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.775682:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626401024 00000100:00100000:1.0:1789351179.775691:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626401024 00000100:00100000:1.0:1789351179.775713:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789351179.775719:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+12:8596:x1876270626401024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351179.775807:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+12:8596:x1876270626401024:12345-0@lo:502:llog_process_th.0 Request processed in 88us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.775813:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789351179.775837:0:8596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941240 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.775846:0:8596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8596:1876270626401024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789351179.775861:0:8596:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789351179.775865:0:8596:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351179.775866:0:8596:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789351179.775869:0:8596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789351179.775907:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789351179.775920:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789351179.775928:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931e00/0xa6ea017771df6c31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c38 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.775938:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931e00/0xa6ea017771df6c31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c38 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351179.775946:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789351179.775949:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d2cf76fd000 from 39 10000000:01000000:1.0:1789351179.775951:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789351179.775970:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.775978:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.775987:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351179.776004:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626401152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.776025:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.776036:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941240 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.776045:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626401152 00000100:00100000:1.0:1789351179.776048:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626401152 00000100:00100000:1.0:1789351179.776064:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789351179.776069:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+12:5820:x1876270626401152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789351179.776076:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351179.776086:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cd5930e00/0xa6ea017771df6c46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6c3f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.776104:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cd5930e00/0xa6ea017771df6c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6c3f expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.776113:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cd5930e00/0xa6ea017771df6c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6c3f expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.776121:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cd5930e00, rc 0) 00000100:00100000:1.0:1789351179.776142:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:5820:x1876270626401152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.776148:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789351179.776170:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626401152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789351179.776180:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c46 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.776188:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6c46 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351179.776226:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626401280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.776245:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.776256:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941240 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.776264:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626401280 00000100:00100000:1.0:1789351179.776267:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626401280 00000100:00100000:1.0:1789351179.776282:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789351179.776287:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:5820:x1876270626401280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.776478:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:5820:x1876270626401280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.776485:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789351179.776508:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626401280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.776527:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626401408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.776553:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.776564:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941240 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.776573:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626401408 00000100:00100000:1.0:1789351179.776576:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626401408 00000100:00100000:1.0:1789351179.776592:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789351179.776596:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:5820:x1876270626401408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.776705:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:5820:x1876270626401408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.776711:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789351179.776739:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626401408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789351179.781000:0:8597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa13b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8597:1876270626401536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789351179.781078:0:8597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351179.781116:0:8597:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf697f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.781201:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626401536 00000100:00100000:1.0:1789351179.781212:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626401536 00000100:00100000:1.0:1789351179.781254:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789351179.781263:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:8597:x1876270626401536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351179.781535:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+13:8597:x1876270626401536:12345-0@lo:502:llog_process_th.0 Request processed in 271us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.781543:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789351179.781649:0:8597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa13b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8597:1876270626401536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789351179.781702:0:8597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8597:1876270626401664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789351179.781738:0:8597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351179.781770:0:8597:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf697f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.781810:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626401664 00000100:00100000:1.0:1789351179.781814:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626401664 00000100:00100000:1.0:1789351179.781844:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789351179.781851:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+13:8597:x1876270626401664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351179.781980:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+13:8597:x1876270626401664:12345-0@lo:502:llog_process_th.0 Request processed in 129us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.781987:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789351179.782053:0:8597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8597:1876270626401664:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789351179.782073:0:8597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789351179.782268:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789351179.782287:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789351179.782296:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c46 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.782307:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c46 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351179.782317:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789351179.782320:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789351179.782322:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789351179.782345:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.782352:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.782413:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351179.782428:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626401792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.782458:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.782477:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941600 going to sleep for 11 seconds 00000100:00100000:0.0:1789351179.782627:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626401792 00000100:00100000:0.0:1789351179.782632:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626401792 00000100:00100000:0.0:1789351179.782668:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789351179.782676:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+13:5820:x1876270626401792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789351179.782684:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351179.782696:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecd9c00/0xa6ea017771df6c54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6c4d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.782717:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecd9c00/0xa6ea017771df6c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6c4d expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.782726:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecd9c00/0xa6ea017771df6c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6c4d expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.782742:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9c00, rc 0) 00000100:00100000:0.0:1789351179.782782:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626401792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351179.782788:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789351179.782879:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626401792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789351179.782892:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.782900:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6c54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351179.782941:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626401920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.782966:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.782991:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941600 going to sleep for 11 seconds 00000100:00100000:0.0:1789351179.783032:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626401920 00000100:00100000:0.0:1789351179.783036:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626401920 00000100:00100000:0.0:1789351179.783066:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789351179.783073:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626401920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351179.783326:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626401920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351179.783333:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789351179.792491:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626401920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789351179.792558:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626402048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789351179.792636:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351179.792668:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc65cea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789351179.792760:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626402048 00000100:00100000:2.0:1789351179.792766:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626402048 00000100:00100000:2.0:1789351179.792808:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789351179.792816:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626402048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789351179.793002:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626402048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351179.793010:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789351179.793056:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626402048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789351179.799567:0:8600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8600:1876270626402176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789351179.799650:0:8600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351179.799694:0:8600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf697f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789351179.799736:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626402176 00000100:00100000:3.0:1789351179.799744:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626402176 00000100:00100000:3.0:1789351179.799786:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789351179.799794:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+14:8600:x1876270626402176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789351179.800010:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+14:8600:x1876270626402176:12345-0@lo:502:llog_process_th.0 Request processed in 216us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351179.800019:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789351179.800100:0:8600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8600:1876270626402176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789351179.800127:0:8600:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789351179.800135:0:8600:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351179.800143:0:8600:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789351179.800149:0:8600:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789351179.800167:0:8600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8600:1876270626402304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789351179.800196:0:8600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351179.800219:0:8600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6eb39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351179.800436:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626402304 00000100:00100000:3.0:1789351179.800440:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626402304 00000100:00100000:3.0:1789351179.800470:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789351179.800477:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:8600:x1876270626402304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789351179.800584:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+14:8600:x1876270626402304:12345-0@lo:502:llog_process_th.0 Request processed in 107us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351179.800591:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789351179.800650:0:8600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8600:1876270626402304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789351179.800666:0:8600:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789351179.800670:0:8600:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351179.800671:0:8600:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789351179.800675:0:8600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1789351179.801078:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789351179.801097:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789351179.801107:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351179.801118:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351179.801127:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789351179.801130:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2cf76fd000 from 4 10000000:01000000:3.0:1789351179.801133:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789351179.801160:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4000/0xa6ea017771df6c5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351179.801169:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4000/0xa6ea017771df6c5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351179.801183:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4000/0xa6ea017771df6c5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351179.801198:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626402432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789351179.801226:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351179.801249:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0788000 going to sleep for 11 seconds 00000100:00100000:3.0:1789351179.801261:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626402432 00000100:00100000:3.0:1789351179.801264:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626402432 00000100:00100000:3.0:1789351179.801284:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789351179.801291:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+14:5820:x1876270626402432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789351179.801299:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351179.801310:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d021c4200/0xa6ea017771df6c62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6c5b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351179.801330:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d021c4200/0xa6ea017771df6c62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6c5b expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351179.801340:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d021c4200/0xa6ea017771df6c62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6c5b expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351179.801349:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c4200, rc 0) 00000100:00100000:3.0:1789351179.801401:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626402432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351179.801408:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789351179.801440:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626402432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789351179.801451:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4000/0xa6ea017771df6c5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351179.801465:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4000/0xa6ea017771df6c5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6c62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351179.801506:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626402560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789351179.801528:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351179.801542:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0788000 going to sleep for 11 seconds 00000100:00100000:3.0:1789351179.801553:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626402560 00000100:00100000:3.0:1789351179.801556:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626402560 00000100:00100000:3.0:1789351179.801575:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789351179.801580:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626402560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789351179.801758:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626402560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351179.801764:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789351179.801789:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626402560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789351179.801808:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626402688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789351179.801836:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351179.801846:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0788000 going to sleep for 11 seconds 00000100:00100000:3.0:1789351179.801855:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626402688 00000100:00100000:3.0:1789351179.801858:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626402688 00000100:00100000:3.0:1789351179.801876:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789351179.801882:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626402688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789351179.802020:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626402688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351179.802028:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789351179.802068:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626402688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.802620:0:8601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8601:1876270626402816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351179.802656:0:8601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.802676:0:8601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941600 going to sleep for 11 seconds 00000100:00100000:3.0:1789351179.802709:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626402816 00000100:00100000:3.0:1789351179.802714:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626402816 00000100:00100000:3.0:1789351179.802766:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789351179.802773:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+15:8601:x1876270626402816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789351179.802896:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+15:8601:x1876270626402816:12345-0@lo:502:llog_process_th.0 Request processed in 123us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351179.802903:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789351179.803049:0:8601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8601:1876270626402816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789351179.803069:0:8601:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789351179.803076:0:8601:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351179.803078:0:8601:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789351179.803085:0:8601:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2cf76fd000 00000020:00000080:1.0:1789351179.803088:0:8601:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789351179.803160:0:8601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8601:1876270626402944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351179.803196:0:8601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.807216:0:8601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941600 going to sleep for 11 seconds 00000100:00100000:0.0:1789351179.807285:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626402944 00000100:00100000:0.0:1789351179.807293:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626402944 00000100:00100000:0.0:1789351179.807328:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789351179.807336:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+15:8601:x1876270626402944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789351179.807635:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+15:8601:x1876270626402944:12345-0@lo:502:llog_process_th.0 Request processed in 298us (4437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351179.807644:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789351179.809058:0:8601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8601:1876270626402944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789351179.809293:0:8601:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789351179.809302:0:8601:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351179.809304:0:8601:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789351179.809308:0:8601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789351179.809425:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789351179.809448:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789351179.809460:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4000/0xa6ea017771df6c5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351179.809472:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4000/0xa6ea017771df6c5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351179.809482:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789351179.809485:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d2cc5fed000 from 39 10000000:01000000:2.0:1789351179.809488:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789351179.809525:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351179.809534:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351179.809545:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351179.809568:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626403072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789351179.809633:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351179.809680:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626403072 00000100:00100000:2.0:1789351179.809682:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789351179.809687:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626403072 00000100:00100000:0.0:1789351179.809734:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789351179.809744:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+15:5820:x1876270626403072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789351179.809756:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351179.809770:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecd9e00/0xa6ea017771df6c70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6c69 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.809806:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecd9e00/0xa6ea017771df6c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6c69 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.809817:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecd9e00/0xa6ea017771df6c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6c69 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.809826:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9e00, rc 0) 00000100:00100000:0.0:1789351179.809867:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626403072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351179.809874:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789351179.809945:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626403072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789351179.809959:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351179.809969:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6c70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351179.810030:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626403200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789351179.810055:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351179.810073:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789351179.810094:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626403200 00000100:00100000:0.0:1789351179.810099:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626403200 00000100:00100000:0.0:1789351179.810160:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789351179.810168:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626403200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351179.810707:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626403200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 539us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351179.810716:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789351179.810735:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626403200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789351179.810836:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626403328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789351179.810931:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351179.810956:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.810968:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626403328 00000100:00100000:1.0:1789351179.810974:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626403328 00000100:00100000:1.0:1789351179.811008:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789351179.811015:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626403328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.811166:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626403328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.811174:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789351179.811191:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626403328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789351179.811689:0:8604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8604:1876270626403456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789351179.811726:0:8604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351179.811750:0:8604:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc311ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789351179.811812:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626403456 00000100:00100000:2.0:1789351179.811818:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626403456 00000100:00100000:2.0:1789351179.811845:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789351179.811853:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+16:8604:x1876270626403456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789351179.812148:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+16:8604:x1876270626403456:12345-0@lo:502:llog_process_th.0 Request processed in 295us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351179.812156:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789351179.812175:0:8604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8604:1876270626403456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789351179.812215:0:8604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8604:1876270626403584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789351179.812245:0:8604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351179.812268:0:8604:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc311ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.812309:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626403584 00000100:00100000:1.0:1789351179.812314:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626403584 00000100:00100000:1.0:1789351179.812396:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789351179.812404:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+16:8604:x1876270626403584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351179.812560:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+16:8604:x1876270626403584:12345-0@lo:502:llog_process_th.0 Request processed in 155us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.812567:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789351179.812572:0:8604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8604:1876270626403584:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789351179.812601:0:8604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789351179.812677:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789351179.812704:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789351179.812713:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.812725:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351179.812733:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789351179.812736:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789351179.812738:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789351179.812759:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.812767:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.812776:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351179.812789:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626403712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789351179.812814:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351179.812836:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc311e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789351179.812847:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626403712 00000100:00100000:2.0:1789351179.812853:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626403712 00000100:00100000:2.0:1789351179.813086:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789351179.813095:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626403712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789351179.813104:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351179.813308:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cf0f78e00/0xa6ea017771df6c7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6c77 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351179.813333:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cf0f78e00/0xa6ea017771df6c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6c77 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351179.813345:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cf0f78e00/0xa6ea017771df6c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6c77 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351179.813354:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cf0f78e00, rc 0) 00000100:00100000:2.0:1789351179.813425:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626403712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 331us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351179.813432:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789351179.813451:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626403712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789351179.813464:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.813474:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6c7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351179.813510:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626403840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351179.813539:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351179.813590:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc311e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.813618:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626403840 00000100:00100000:1.0:1789351179.813622:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626403840 00000100:00100000:1.0:1789351179.813677:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789351179.813685:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626403840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.813850:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626403840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.813859:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789351179.813968:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa13100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626403840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789351179.814045:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626403968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789351179.814082:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351179.814110:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789351179.814169:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626403968 00000100:00100000:3.0:1789351179.814174:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626403968 00000100:00100000:3.0:1789351179.814200:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789351179.814207:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626403968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789351179.814342:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626403968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351179.814349:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789351179.814485:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626403968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789351179.814701:0:8605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8605:1876270626404096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789351179.814733:0:8605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351179.814760:0:8605:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf9d92240 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.815446:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626404096 00000100:00100000:1.0:1789351179.815452:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626404096 00000100:00100000:1.0:1789351179.815486:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789351179.815493:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:8605:x1876270626404096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351179.815673:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:8605:x1876270626404096:12345-0@lo:502:llog_process_th.0 Request processed in 181us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.815680:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789351179.815693:0:8605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8605:1876270626404096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789351179.815717:0:8605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789351179.815727:0:8605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351179.815729:0:8605:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789351179.815735:0:8605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789351179.815756:0:8605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8605:1876270626404224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789351179.815793:0:8605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351179.815824:0:8605:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf9d92240 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.815995:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626404224 00000100:00100000:1.0:1789351179.815999:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626404224 00000100:00100000:1.0:1789351179.816025:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789351179.816032:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+17:8605:x1876270626404224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351179.816176:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+17:8605:x1876270626404224:12345-0@lo:502:llog_process_th.0 Request processed in 143us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.816182:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789351179.816196:0:8605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8605:1876270626404224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789351179.816212:0:8605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351179.816217:0:8605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351179.816218:0:8605:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789351179.816222:0:8605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789351179.816285:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1789351179.816305:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789351179.816315:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.816326:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351179.816335:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789351179.816338:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2cc5fed000 from 4 10000000:01000000:0.0:1789351179.816340:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789351179.816439:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd9800/0xa6ea017771df6c85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.816449:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd9800/0xa6ea017771df6c85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.816459:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd9800/0xa6ea017771df6c85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351179.816472:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626404352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789351179.816502:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351179.816556:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc311e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.816583:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626404352 00000100:00100000:1.0:1789351179.816586:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626404352 00000100:00100000:1.0:1789351179.816606:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789351179.816613:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626404352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789351179.816621:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351179.816632:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6c8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6c85 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.816652:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6c8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6c85 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.816661:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6c8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6c85 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.816675:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cd5931c00, rc 0) 00000100:00100000:1.0:1789351179.816736:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626404352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.816742:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789351179.816782:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626404352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789351179.816794:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd9800/0xa6ea017771df6c85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c8c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351179.816808:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd9800/0xa6ea017771df6c85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6c8c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351179.816836:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626404480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351179.816853:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351179.816890:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc311e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.816910:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626404480 00000100:00100000:1.0:1789351179.816913:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626404480 00000100:00100000:1.0:1789351179.816934:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789351179.816940:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626404480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.817152:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626404480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.817157:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789351179.817194:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626404480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351179.817211:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626404608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789351179.817233:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351179.817269:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc311e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.817289:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626404608 00000100:00100000:1.0:1789351179.817292:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626404608 00000100:00100000:1.0:1789351179.817310:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789351179.817316:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626404608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789351179.817624:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626404608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 307us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351179.817632:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789351179.817651:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626404608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789351179.817924:0:8606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8606:1876270626404736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789351179.817962:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.817994:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626404736 00000100:00100000:1.0:1789351179.817998:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626404736 00000100:00100000:2.0:1789351179.818000:0:8606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.818022:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789351179.818029:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:8606:x1876270626404736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351179.818146:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:8606:x1876270626404736:12345-0@lo:502:llog_process_th.0 Request processed in 116us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.818153:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789351179.818170:0:8606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8606:1876270626404736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789351179.818193:0:8606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789351179.818201:0:8606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351179.818203:0:8606:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789351179.818210:0:8606:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2cc5fed000 00000020:00000080:2.0:1789351179.818213:0:8606:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789351179.818282:0:8606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8606:1876270626404864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789351179.818316:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351179.818340:0:8606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789351179.818403:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626404864 00000100:00100000:1.0:1789351179.818407:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626404864 00000100:00100000:1.0:1789351179.818433:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789351179.818446:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+18:8606:x1876270626404864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351179.818536:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+18:8606:x1876270626404864:12345-0@lo:502:llog_process_th.0 Request processed in 91us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.818541:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789351179.818551:0:8606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:8606:1876270626404864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789351179.818574:0:8606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789351179.818579:0:8606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351179.818581:0:8606:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789351179.818585:0:8606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789351179.819558:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789351179.819577:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789351179.819585:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd9800/0xa6ea017771df6c85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c8c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.819592:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd9800/0xa6ea017771df6c85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c8c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351179.819599:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789351179.819600:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2cd83919c0 from 1 10000000:01000000:1.0:1789351179.819602:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789351179.819622:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.819628:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.819635:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351179.819646:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626404992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.819675:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.819702:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3fdd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789351179.819709:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626404992 00000100:00100000:3.0:1789351179.819714:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626404992 00000100:00100000:3.0:1789351179.819746:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789351179.819753:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626404992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789351179.819762:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351179.819773:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d021c5800/0xa6ea017771df6c9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6c93 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351179.819793:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d021c5800/0xa6ea017771df6c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6c93 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351179.819801:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d021c5800/0xa6ea017771df6c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6c93 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351179.819810:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c5800, rc 0) 00000100:00100000:3.0:1789351179.819850:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:5820:x1876270626404992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351179.819856:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789351179.819896:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626404992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789351179.819912:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6c93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c9a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.819923:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6c93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6c9a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351179.819955:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626405120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351179.819972:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.819988:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3fdd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789351179.820004:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626405120 00000100:00100000:3.0:1789351179.820008:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626405120 00000100:00100000:3.0:1789351179.820036:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789351179.820043:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:5820:x1876270626405120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789351179.820251:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:5820:x1876270626405120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (276us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789351179.820257:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789351179.820328:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626405120:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789351179.820351:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789351179.820386:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6c93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c9a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351179.820394:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c9a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351179.937983:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789351179.938006:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626405248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789351179.938074:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351179.938387:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626405248 00000100:00100000:3.0:1789351179.938395:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626405248 00000100:00100000:3.0:1789351179.938458:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789351179.938468:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626405248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789351179.938500:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789351179.938548:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626405248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351179.938556:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789351179.938595:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789351179.938760:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626405504:0@lo:400:kworker.0 00000100:00100000:2.0:1789351179.938791:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351179.938813:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789351179.938819:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626405632:0@lo:400:kworker.0 00000100:00100000:2.0:1789351179.938842:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.939150:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876270626405760:0@lo:400:kworker.0 00000100:00100000:1.0:1789351179.939181:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.939202:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789351179.939207:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626405376:0@lo:400:kworker.0 00000100:00100000:1.0:1789351179.939236:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351179.939262:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626405504 00000100:00100000:1.0:1789351179.939267:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626405504 00000100:00100000:3.0:1789351179.939569:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626405632 00000100:00100000:3.0:1789351179.939573:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626405632 00000100:00100000:2.0:1789351179.939680:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626405760 00000100:00100000:2.0:1789351179.939685:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626405760 00000100:00100000:1.0:1789351179.939749:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626405376 00000100:00100000:1.0:1789351179.939753:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626405376 00000100:00100000:1.0:1789351179.939772:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789351179.939780:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626405504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351179.939823:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626405504:12345-0@lo:400:kworker.0 Request processed in 44us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.939835:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789351179.939851:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789351179.939857:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626405376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351179.939896:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626405376:12345-0@lo:400:kworker.0 Request processed in 39us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351179.939902:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789351179.939946:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626405376:0@lo:400:kworker.0 00010000:00080000:1.0:1789351179.940291:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc31d1180 x1876270626405248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351179.940301:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789351179.940317:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626405248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789351179.940467:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789351179.940475:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626405632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351179.940513:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626405632:12345-0@lo:400:kworker.0 Request processed in 40us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351179.940519:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789351179.940537:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789351179.940540:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789351179.940580:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc31d0380 x1876270626405632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351179.940590:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626405632:0@lo:400:kworker.0 00000100:00100000:3.0:1789351179.940600:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626405504:0@lo:400:kworker.0 00000100:00100000:2.0:1789351179.945239:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789351179.945255:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876270626405760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351179.945523:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876270626405760:12345-0@lo:400:kworker.0 Request processed in 271us (6339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351179.945531:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789351179.945580:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876270626405760:0@lo:400:kworker.0 00010000:00010000:3.0:1789351180.264468:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789351181.102939:0:8774:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789351181.282482:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351182.307407:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351183.009750:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626405888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789351183.009848:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351183.009945:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626405888 00000100:00100000:1.0:1789351183.009956:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626405888 00000100:00100000:1.0:1789351183.010022:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789351183.010033:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626405888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789351183.010082:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789351183.010134:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626405888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351183.010142:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789351183.010166:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789351183.010203:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc31d0000 x1876270626405888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351183.010236:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626405888:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789351183.329514:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789351183.627425:0:9018:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing yml_node 00010000:00010000:2.0:1789351184.358468:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351184.810107:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351184.810230:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351184.810276:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351184.810325:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351184.810385:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616943232 00000100:00100000:3.0:1789351184.810396:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616943232 00000100:00100000:3.0:1789351184.810464:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616943104 00000100:00100000:3.0:1789351184.810467:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616943104 00000100:00100000:3.0:1789351184.810491:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1789351184.810519:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:2350:x1876270616943232:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351184.810620:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:2350:x1876270616943232:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 118us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351184.810690:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1789351184.810709:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:3.0:1789351184.810715:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:2349:x1876270616943104:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351184.810740:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:2349:x1876270616943104:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 26us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351184.810746:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00080000:3.0:1789351184.810886:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789351184.810892:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789351184.812095:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616942848 00000100:00100000:0.0:1789351184.812107:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616942848 00000100:00100000:0.0:1789351184.812170:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 183 00000100:00100000:0.0:1789351184.812180:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:2349:x1876270616942848:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351184.812253:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:2349:x1876270616942848:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 75us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351184.812263:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 183 00000100:00100000:1.0:1789351184.812396:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616942976 00000100:00100000:1.0:1789351184.812402:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616942976 00000100:00100000:1.0:1789351184.812461:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:1.0:1789351184.812470:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:2350:x1876270616942976:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789351184.812526:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:2350:x1876270616942976:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 58us (2436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351184.812533:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00080000:3.0:1789351184.812800:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351185.057618:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626406144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789351185.057626:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626406016:0@lo:400:kworker.0 00000100:00100000:1.0:1789351185.057677:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626406272:0@lo:400:kworker.0 00000100:00100000:0.0:1789351185.058440:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876270626406400:0@lo:400:kworker.0 00000100:00100000:2.0:1789351185.058598:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351185.058973:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626406528:0@lo:400:kworker.0 00000100:00100000:2.0:1789351185.059010:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351185.059037:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789351185.059044:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626406656:0@lo:400:kworker.0 00000100:00100000:2.0:1789351185.059072:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351185.059114:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626406656 00000100:00100000:2.0:1789351185.059123:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626406656 00000100:00100000:2.0:1789351185.059192:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789351185.059204:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876270626406656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351185.059345:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876270626406656:12345-0@lo:400:kworker.0 Request processed in 143us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351185.059354:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1789351185.059402:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789351185.059441:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626406656:0@lo:400:kworker.0 00000100:00100000:2.0:1789351185.061117:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626406528 00000100:00100000:2.0:1789351185.061133:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626406528 00000100:00100000:2.0:1789351185.061198:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789351185.061210:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626406528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351185.061972:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626406528:12345-0@lo:400:kworker.0 Request processed in 761us (2957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351185.061983:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789351185.061989:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789351185.062014:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789351185.062035:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626406144 00000100:00100000:3.0:1789351185.062042:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626406144 00010000:00080000:2.0:1789351185.062058:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc31a6d80 x1876270626406528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351185.062075:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626406528:0@lo:400:kworker.0 00000100:00100000:3.0:1789351185.062100:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789351185.062111:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626406144:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789351185.062120:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1789351185.062148:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1789351185.062241:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf772ca80 x1876270626406144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351185.062351:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626406144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789351185.062445:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626406144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 335us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351185.062454:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789351185.062455:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626406016 00000100:00100000:2.0:1789351185.062461:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626406016 00000100:00100000:2.0:1789351185.062497:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789351185.062506:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3288:x1876270626406016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351185.062570:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3288:x1876270626406016:12345-0@lo:400:kworker.0 Request processed in 66us (3972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351185.062577:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789351185.062611:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626406016:0@lo:400:kworker.0 00000100:00100000:0.0:1789351185.063968:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351185.064029:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626406400 00000100:00100000:0.0:1789351185.064037:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626406400 00000100:00100000:0.0:1789351185.064089:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789351185.064099:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876270626406400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351185.064157:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876270626406400:12345-0@lo:400:kworker.0 Request processed in 60us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351185.064164:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789351185.064185:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789351185.064214:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876270626406400:0@lo:400:kworker.0 00000100:00100000:0.0:1789351185.064271:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351185.064305:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626406272 00000100:00100000:0.0:1789351185.064309:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626406272 00000100:00100000:0.0:1789351185.064334:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789351185.064339:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626406272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351185.064391:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626406272:12345-0@lo:400:kworker.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351185.064398:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789351185.064424:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626406272:0@lo:400:kworker.0 00000100:00100000:0.0:1789351185.064436:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626406784:0@lo:400:kworker.0 00000100:00100000:0.0:1789351185.064466:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351185.064499:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626406784 00000100:00100000:0.0:1789351185.064503:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626406784 00000100:00100000:0.0:1789351185.069801:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789351185.069839:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626406784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351185.070281:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626406784:12345-0@lo:400:kworker.0 Request processed in 461us (5812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351185.070324:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789351185.070740:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc31a7480 x1876270626406784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351185.070761:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626406784:0@lo:400:kworker.0 00010000:00010000:0.0:1789351185.378036:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789351185.735257:0:9212:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.56.50 00010000:00010000:0.0:1789351186.406139:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789351187.334964:0:9309:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.56.50 00010000:00010000:2.0:1789351187.431536:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351188.130091:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789351188.130948:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626406912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789351188.131021:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351188.131265:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626406912 00000100:00100000:2.0:1789351188.131274:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626406912 00000100:00100000:2.0:1789351188.131402:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789351188.131413:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626406912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789351188.131449:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789351188.131500:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626406912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351188.131520:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789351188.131720:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc31d0700 x1876270626406912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351188.131752:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626406912:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789351188.131915:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789351188.454777:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789351189.014981:0:9406:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.56.50 00010000:00010000:0.0:1789351189.477406:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351189.933689:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351189.933734:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351189.933770:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351189.933794:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351189.933822:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616943488 00000100:00100000:3.0:1789351189.933823:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616943616 00000100:00100000:3.0:1789351189.933830:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616943616 00000100:00100000:0.0:1789351189.933830:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616943488 00000100:00100000:0.0:1789351189.933889:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:2.0:1789351189.933897:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616943360 00000100:00100000:0.0:1789351189.933903:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+6:2349:x1876270616943488:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351189.933904:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616943360 00000100:00100000:2.0:1789351189.933941:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 185 00000100:00100000:2.0:1789351189.933950:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:2349:x1876270616943360:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351189.933987:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+6:2349:x1876270616943488:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 87us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351189.933988:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:2349:x1876270616943360:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 36us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351189.934007:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 185 00000100:00100000:0.0:1789351189.934008:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:2.0:1789351189.934045:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616943744 00000100:00100000:2.0:1789351189.934049:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616943744 00000100:00100000:3.0:1789351189.934159:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:3.0:1789351189.934169:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+5:2349:x1876270616943616:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351189.934199:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+5:2349:x1876270616943616:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351189.934206:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00080000:0.0:1789351189.940438:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789351189.940449:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789351189.940453:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789351189.941763:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:2.0:1789351189.941779:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:2349:x1876270616943744:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351189.941863:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:2349:x1876270616943744:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 89us (8068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351189.941871:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000001:02000400:3.0:1789351189.982454:0:9454:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sun Sep 13 21:59:49 EDT 2026 00000100:00100000:3.0:1789351190.177844:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626407040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789351190.177904:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351190.177965:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626407040 00000100:00100000:3.0:1789351190.177971:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626407040 00000100:00100000:3.0:1789351190.178108:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789351190.178117:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626407040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789351190.178150:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789351190.178255:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626407040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351190.178279:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789351190.178297:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789351190.178325:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf772c700 x1876270626407040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351190.178340:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626407040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789351190.178939:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626407296:0@lo:400:kworker.0 00000100:00100000:2.0:1789351190.179002:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876270626407424:0@lo:400:kworker.0 00000100:00100000:2.0:1789351190.179026:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351190.179067:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626407424 00000100:00100000:2.0:1789351190.179071:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626407424 00000100:00100000:1.0:1789351190.179100:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626407552:0@lo:400:kworker.0 00000100:00100000:2.0:1789351190.179106:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789351190.179116:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876270626407424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351190.179140:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351190.179166:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789351190.179170:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876270626407424:12345-0@lo:400:kworker.0 Request processed in 56us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351190.179174:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626407168:0@lo:400:kworker.0 00000100:00100000:2.0:1789351190.179185:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789351190.179229:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351190.179240:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876270626407424:0@lo:400:kworker.0 00000100:00100000:1.0:1789351190.179259:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626407680:0@lo:400:kworker.0 00000100:00100000:2.0:1789351190.179270:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626407168 00000100:00100000:2.0:1789351190.179274:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626407168 00000100:00100000:1.0:1789351190.179283:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351190.179299:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789351190.179306:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3288:x1876270626407168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351190.179318:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626407680 00000100:00100000:1.0:1789351190.179323:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626407680 00000100:00100000:2.0:1789351190.179338:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3288:x1876270626407168:12345-0@lo:400:kworker.0 Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351190.179344:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789351190.179383:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789351190.179393:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876270626407680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351190.179400:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351190.179424:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789351190.179430:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789351190.179434:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876270626407680:12345-0@lo:400:kworker.0 Request processed in 43us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351190.179441:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789351190.179463:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626407296 00000100:00100000:1.0:1789351190.179466:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626407296 00000100:00100000:1.0:1789351190.179482:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789351190.179487:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626407296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351190.179520:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626407296:12345-0@lo:400:kworker.0 Request processed in 33us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351190.179526:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789351190.179606:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626407296:0@lo:400:kworker.0 00000100:00100000:1.0:1789351190.179638:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626407168:0@lo:400:kworker.0 00000100:00100000:1.0:1789351190.179650:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626407680:0@lo:400:kworker.0 00000100:00100000:3.0:1789351190.179790:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626407552 00000100:00100000:3.0:1789351190.179794:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626407552 00000100:00100000:3.0:1789351190.179816:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789351190.179821:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626407552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351190.179856:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626407552:12345-0@lo:400:kworker.0 Request processed in 35us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351190.179860:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789351190.180005:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789351190.180008:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789351190.180195:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc31d0000 x1876270626407552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351190.180206:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626407552:0@lo:400:kworker.0 00010000:00010000:2.0:1789351190.497516:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351191.523569:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351192.550256:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351193.249660:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789351193.249755:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf772c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626407808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789351193.249818:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351193.249871:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626407808 00000100:00100000:3.0:1789351193.249877:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626407808 00000100:00080000:0.0:1789351193.249906:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789351193.249922:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789351193.249930:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626407808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789351193.249960:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789351193.250002:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626407808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351193.250006:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789351193.250216:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf772c700 x1876270626407808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351193.250251:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf772c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626407808:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789351193.569658:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351194.593639:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351195.052590:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351195.052644:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351195.052713:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616943872 00000100:00100000:3.0:1789351195.052725:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616943872 00000100:00100000:3.0:1789351195.052798:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 187 00000100:00100000:3.0:1789351195.052811:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:2347:x1876270616943872:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351195.052930:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:2347:x1876270616943872:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 121us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351195.052939:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 187 00000100:00100000:2.0:1789351195.053214:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616944000 00000100:00100000:2.0:1789351195.053220:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616944000 00000100:00100000:2.0:1789351195.053283:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:2.0:1789351195.053292:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:2347:x1876270616944000:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351195.053337:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:2347:x1876270616944000:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 47us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351195.053345:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00080000:3.0:1789351195.053476:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789351195.062000:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351195.062039:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351195.062075:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616944128 00000100:00100000:2.0:1789351195.062090:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616944128 00000100:00100000:2.0:1789351195.062176:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616944256 00000100:00100000:2.0:1789351195.062180:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616944256 00000100:00100000:2.0:1789351195.062216:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:2.0:1789351195.062228:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+5:2346:x1876270616944128:12345-192.168.201.52@tcp:9:kworker.0 00000020:00000080:2.0:1789351195.062276:0:6661:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6b66 00000100:00080000:2.0:1789351195.062289:0:6661:0:(import.c:65:import_set_state_nolock()) ffff8d2cd84a5000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789351195.062339:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1789351195.064304:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789351195.064329:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789351195.064335:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789351195.064790:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+2:2346:x1876270616944128:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 2549us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351195.064805:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:2.0:1789351195.064836:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:2.0:1789351195.064853:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+5:2346:x1876270616944256:12345-192.168.201.52@tcp:9:kworker.0 00000020:00000080:2.0:1789351195.064892:0:6661:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6b6d 00000100:00080000:2.0:1789351195.064906:0:6661:0:(import.c:65:import_set_state_nolock()) ffff8d2cd83af000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789351195.064954:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1789351195.064993:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789351195.065222:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+2:2346:x1876270616944256:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 375us (3181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351195.065229:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:0.0:1789351195.298834:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626407936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789351195.298929:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351195.299177:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626407936 00000100:00100000:0.0:1789351195.299188:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626407936 00000100:00100000:0.0:1789351195.299251:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789351195.299263:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626407936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789351195.299311:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789351195.299400:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626407936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351195.299408:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789351195.299735:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc6f67480 x1876270626407936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351195.299759:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626407936:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789351195.302444:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789351195.306837:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876270626408192:0@lo:400:kworker.0 00000100:00100000:2.0:1789351195.306932:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351195.306999:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626408192 00000100:00100000:2.0:1789351195.307009:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626408192 00000100:00100000:3.0:1789351195.307100:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626408064:0@lo:400:kworker.0 00000100:00100000:3.0:1789351195.307156:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351195.307317:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626408576:0@lo:400:kworker.0 00000100:00100000:3.0:1789351195.307344:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351195.307505:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626408576 00000100:00100000:2.0:1789351195.307509:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626408576 00000100:00100000:2.0:1789351195.307613:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789351195.307626:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876270626408192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351195.307756:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876270626408192:12345-0@lo:400:kworker.0 Request processed in 131us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351195.307776:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789351195.307806:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789351195.307813:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876270626408576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351195.307848:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876270626408576:12345-0@lo:400:kworker.0 Request processed in 36us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351195.307854:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789351195.308898:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876270626408192:0@lo:400:kworker.0 00000100:00100000:2.0:1789351195.311524:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626408064 00000100:00100000:2.0:1789351195.311543:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626408064 00000100:00100000:2.0:1789351195.311606:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789351195.311617:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3288:x1876270626408064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351195.311790:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626408448:0@lo:400:kworker.0 00000100:00100000:2.0:1789351195.311878:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351195.311925:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789351195.311934:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876270626408320:0@lo:400:kworker.0 00000100:00100000:2.0:1789351195.311964:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351195.312030:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626408448 00000100:00100000:2.0:1789351195.312035:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626408448 00000100:00100000:2.0:1789351195.312073:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789351195.312081:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626408448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351195.312138:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626408448:12345-0@lo:400:kworker.0 Request processed in 46us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351195.312147:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789351195.312174:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626408320 00000100:00100000:2.0:1789351195.312178:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626408320 00000100:00100000:2.0:1789351195.312219:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789351195.312228:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876270626408320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351195.312269:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876270626408320:12345-0@lo:400:kworker.0 Request processed in 42us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351195.312276:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789351195.312304:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789351195.312310:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789351195.312332:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3288:x1876270626408064:12345-0@lo:400:kworker.0 Request processed in 715us (5173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351195.312342:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789351195.312384:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626408064:0@lo:400:kworker.0 00000100:00100000:3.0:1789351195.312405:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626408576:0@lo:400:kworker.0 00000100:00100000:3.0:1789351195.312511:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876270626408320:0@lo:400:kworker.0 00010000:00080000:3.0:1789351195.312528:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc6f67480 x1876270626408448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351195.312537:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626408448:0@lo:400:kworker.0 00000001:00100000:0.0:1789351195.330848:0:7616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8237986d-b9e8-417a-ac8f-a078390d268c 00000020:00000080:0.0:1789351195.330862:0:7616:0:(genops.c:906:class_export_put()) final put ffff8d2cd84a1800/8237986d-b9e8-417a-ac8f-a078390d268c 00000020:00000080:3.0:1789351195.331667:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cd84a1800/8237986d-b9e8-417a-ac8f-a078390d268c for lustre-OST0001 00000020:00000080:3.0:1789351195.331734:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2cd83af000 for lustre-OST0001 00010000:00010000:0.0:1789351195.617975:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351196.641554:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351197.666281:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789351198.287409:0:10084:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:59:57 (1789351197) === 00000100:00100000:1.0:1789351198.369529:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789351198.369553:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626408704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789351198.369623:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351198.369720:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626408704 00000100:00100000:0.0:1789351198.369727:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626408704 00000100:00100000:0.0:1789351198.369797:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789351198.369808:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626408704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789351198.369840:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789351198.369888:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626408704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351198.369896:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789351198.369935:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cffa13100 x1876270626408704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351198.369954:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626408704:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789351198.370005:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789351198.481505:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351198.481615:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616944384 00000100:00100000:0.0:1789351198.481625:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616944384 00000100:00100000:0.0:1789351198.481681:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 189 00000100:00100000:0.0:1789351198.481690:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ce9d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:8117:x1876270616944384:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789351198.481705:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351198.481723:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecd9200/0xa6ea017771df6ca1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7bd1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351198.481812:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecd9200/0xa6ea017771df6ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bd1 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351198.481826:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecd9200/0xa6ea017771df6ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bd1 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351198.481836:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9200, rc 0) 00000100:00100000:0.0:1789351198.481907:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ce9d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:8117:x1876270616944384:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 218us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351198.481915:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 189 00000100:00100000:2.0:1789351198.485594:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351198.485737:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616944512 00000100:00100000:0.0:1789351198.485744:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616944512 00000100:00100000:0.0:1789351198.485792:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 190 00000100:00100000:0.0:1789351198.485800:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ce9d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:8117:x1876270616944512:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789351198.486093:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ce9d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:8117:x1876270616944512:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 292us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351198.486098:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 190 00000100:00100000:2.0:1789351198.488239:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351198.488291:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616944640 00000100:00100000:0.0:1789351198.488297:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616944640 00000100:00100000:0.0:1789351198.488332:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 191 00000100:00100000:0.0:1789351198.488340:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ce9d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:8117:x1876270616944640:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789351198.488563:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ce9d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:8117:x1876270616944640:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 223us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351198.488569:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 191 00000100:00100000:2.0:1789351198.491213:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351198.491393:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616944768 00000100:00100000:3.0:1789351198.491404:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616944768 00000100:00100000:3.0:1789351198.491464:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 192 00000100:00100000:3.0:1789351198.491474:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:8121:x1876270616944768:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789351198.491714:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:8121:x1876270616944768:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 241us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351198.491723:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 192 00000100:00100000:2.0:1789351198.503454:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351198.503545:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616944896 00000100:00100000:0.0:1789351198.503556:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616944896 00000100:00100000:3.0:1789351198.503635:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 193 00000100:00100000:3.0:1789351198.503646:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:8121:x1876270616944896:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789351198.503878:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:8121:x1876270616944896:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 233us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351198.503886:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 193 00000100:00100000:0.0:1789351198.509004:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351198.509337:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616945024 00000100:00100000:2.0:1789351198.509345:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616945024 00000100:00100000:2.0:1789351198.509431:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 194 00000100:00100000:2.0:1789351198.509445:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8338050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:8117:x1876270616945024:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789351198.509460:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351198.509474:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cf0f78400/0xa6ea017771df6ca8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7bfb expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351198.509498:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cf0f78400/0xa6ea017771df6ca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bfb expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351198.509507:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cf0f78400/0xa6ea017771df6ca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bfb expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351198.509515:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cf0f78400, rc 0) 00000100:00100000:2.0:1789351198.509560:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8338050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:8117:x1876270616945024:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 123us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351198.509577:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 194 00000100:00100000:2.0:1789351198.511909:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351198.511960:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616945152 00000100:00100000:0.0:1789351198.511969:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616945152 00000100:00100000:0.0:1789351198.512005:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 195 00000100:00100000:0.0:1789351198.512012:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8339450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:8117:x1876270616945152:12345-192.168.201.52@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789351198.512029:0:5817:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789351198.512046:0:5817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789351198.512049:0:5817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789351198.512051:0:5817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789351198.512052:0:5817:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789351198.514012:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8339450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:8117:x1876270616945152:12345-192.168.201.52@tcp:256:mount.lustre.0 Request processed in 1993us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351198.514030:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 195 00000100:00100000:2.0:1789351198.516218:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351198.516273:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616945280 00000100:00100000:0.0:1789351198.516280:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616945280 00000100:00100000:0.0:1789351198.516319:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 196 00000100:00100000:0.0:1789351198.516328:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:8117:x1876270616945280:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789351198.516344:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351198.516382:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecd9a00/0xa6ea017771df6caf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c02 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351198.516410:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecd9a00/0xa6ea017771df6caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c02 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351198.516422:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecd9a00/0xa6ea017771df6caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c02 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351198.516432:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9a00, rc 0) 00000100:00100000:0.0:1789351198.516475:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:8117:x1876270616945280:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 147us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351198.516483:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 196 00000100:00100000:2.0:1789351198.524745:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351198.524799:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616945408 00000100:00100000:0.0:1789351198.524808:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616945408 00000100:00100000:0.0:1789351198.524858:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 197 00000100:00100000:0.0:1789351198.524878:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:8117:x1876270616945408:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789351198.525142:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:8117:x1876270616945408:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 265us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351198.525150:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 197 00000100:00100000:3.0:1789351198.526541:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351198.526587:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616945536 00000100:00100000:0.0:1789351198.526593:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616945536 00000100:00100000:0.0:1789351198.526642:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 198 00000100:00100000:0.0:1789351198.526651:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:8117:x1876270616945536:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789351198.526797:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:8117:x1876270616945536:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 147us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351198.526804:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 198 00000100:00100000:2.0:1789351198.529528:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351198.529628:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616945664 00000100:00100000:0.0:1789351198.529638:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616945664 00000100:00100000:0.0:1789351198.529687:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 199 00000100:00100000:0.0:1789351198.529697:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:8124:x1876270616945664:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789351198.529936:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:8124:x1876270616945664:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 239us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351198.529944:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 199 00000100:00100000:2.0:1789351198.531641:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351198.531688:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616945792 00000100:00100000:0.0:1789351198.531695:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616945792 00000100:00100000:0.0:1789351198.531728:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 200 00000100:00100000:0.0:1789351198.531737:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:8124:x1876270616945792:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789351198.531893:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:8124:x1876270616945792:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 157us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351198.531901:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 200 00000100:00100000:3.0:1789351198.535470:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351198.535509:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351198.535586:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616946048 00000100:00100000:0.0:1789351198.535595:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616946048 00000100:00100000:0.0:1789351198.535668:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616945920 00000100:00100000:0.0:1789351198.535672:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616945920 00000100:00080000:1.0:1789351198.535679:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789351198.535694:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:0.0:1789351198.535718:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+6:2347:x1876270616946048:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351198.535738:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:2.0:1789351198.535744:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2346:x1876270616945920:12345-192.168.201.52@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789351198.535766:0:5824:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 8d53186e-ebf3-44d4-99b7-0a4ed0545c2b@192.168.201.52@tcp t0 exp 0000000000000000 cur 142 last 0 00000100:00100000:0.0:1789351198.535795:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+6:2347:x1876270616946048:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 82us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351198.535803:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00000020:00000080:2.0:1789351198.535805:0:5824:0:(genops.c:1406:class_connect()) connect: client 8d53186e-ebf3-44d4-99b7-0a4ed0545c2b, cookie 0xa6ea017771df6cb6 00000004:00100000:2.0:1789351198.535844:0:5824:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789351198.536122:0:5824:0:(import.c:65:import_set_state_nolock()) ffff8d2cffa1d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789351198.536169:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+6:2346:x1876270616945920:12345-192.168.201.52@tcp:38:mount.lustre.0 Request processed in 423us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351198.536176:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1789351198.537626:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351198.537661:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351198.537687:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616946176 00000100:00100000:0.0:1789351198.537695:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616946176 00000100:00100000:0.0:1789351198.537795:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616946304 00000100:00100000:0.0:1789351198.537799:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616946304 00000100:00100000:1.0:1789351198.537807:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:1.0:1789351198.537822:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+7:0:x1876270616946176:12345-192.168.201.52@tcp:41:mount.lustre.0 00000100:00100000:0.0:1789351198.537829:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1789351198.537839:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+7:8117:x1876270616946304:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789351198.537856:0:9467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:0.0:1789351198.537859:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789351198.537973:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+7:0:x1876270616946176:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 155us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351198.537981:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00080000:3.0:1789351198.538017:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789351198.538115:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+6:8117:x1876270616946304:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 278us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351198.538120:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1789351198.539350:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351198.539527:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616946432 00000100:00100000:2.0:1789351198.539534:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616946432 00000100:00100000:2.0:1789351198.539571:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:2.0:1789351198.539577:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+6:8117:x1876270616946432:12345-192.168.201.52@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789351198.539626:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+6:8117:x1876270616946432:12345-192.168.201.52@tcp:40:mount.lustre.0 Request processed in 50us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351198.539631:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:2.0:1789351198.545627:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351198.545673:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351198.545707:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351198.545828:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616946816 00000100:00100000:1.0:1789351198.545838:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616946816 00000100:00100000:1.0:1789351198.545898:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:1.0:1789351198.545908:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+6:8117:x1876270616946816:12345-192.168.201.52@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789351198.546217:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1789351198.546353:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+6:8117:x1876270616946816:12345-192.168.201.52@tcp:33:mount.lustre.0 Request processed in 446us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351198.546462:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:3.0:1789351198.546658:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616946560 00000100:00100000:3.0:1789351198.546663:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616946560 00000100:00100000:3.0:1789351198.546690:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616946688 00000100:00100000:3.0:1789351198.546693:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616946688 00000100:00100000:3.0:1789351198.546704:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:3.0:1789351198.546710:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1876270616946560:12345-192.168.201.52@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789351198.546737:0:6660:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 8d53186e-ebf3-44d4-99b7-0a4ed0545c2b@192.168.201.52@tcp t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:3.0:1789351198.546763:0:6660:0:(genops.c:1406:class_connect()) connect: client 8d53186e-ebf3-44d4-99b7-0a4ed0545c2b, cookie 0xa6ea017771df6cbd 00002000:00100000:3.0:1789351198.546776:0:6660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8d53186e-ebf3-44d4-99b7-0a4ed0545c2b/ffff8d2cffaeb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789351198.546786:0:6660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789351198.546876:0:6660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789351198.546903:0:6660:0:(import.c:65:import_set_state_nolock()) ffff8d2cffaea800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789351198.546942:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+6:2346:x1876270616946560:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 231us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351198.546949:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:3.0:1789351198.546963:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:3.0:1789351198.546967:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1876270616946688:12345-192.168.201.52@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789351198.546982:0:6660:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 8d53186e-ebf3-44d4-99b7-0a4ed0545c2b@192.168.201.52@tcp t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:3.0:1789351198.546998:0:6660:0:(genops.c:1406:class_connect()) connect: client 8d53186e-ebf3-44d4-99b7-0a4ed0545c2b, cookie 0xa6ea017771df6cc4 00002000:00100000:3.0:1789351198.547003:0:6660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8d53186e-ebf3-44d4-99b7-0a4ed0545c2b/ffff8d2cffaed800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789351198.547019:0:6660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789351198.547164:0:6660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789351198.547178:0:6660:0:(import.c:65:import_set_state_nolock()) ffff8d2cffaea000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789351198.547201:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+6:2346:x1876270616946688:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 232us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351198.547208:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00010000:00010000:3.0:1789351198.692044:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351199.713565:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789351199.950025:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8237986d-b9e8-417a-ac8f-a078390d268c 00000020:00000080:1.0:1789351199.950037:0:6689:0:(genops.c:906:class_export_put()) final put ffff8d2cd84a3800/8237986d-b9e8-417a-ac8f-a078390d268c 00000001:00100000:1.0:1789351199.950079:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8d53186e-ebf3-44d4-99b7-0a4ed0545c2b 00000020:00000080:3.0:1789351199.950087:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cd84a3800/8237986d-b9e8-417a-ac8f-a078390d268c for lustre-OST0000 00000020:00000080:3.0:1789351199.950151:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2cd84a5000 for lustre-OST0000 00000100:00100000:1.0:1789351200.419981:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876270626408960:0@lo:400:kworker.0 00000100:00100000:1.0:1789351200.420074:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351200.420121:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626409472:0@lo:400:kworker.0 00000100:00100000:1.0:1789351200.420147:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351200.420175:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789351200.420179:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626408832:0@lo:400:kworker.0 00000100:00100000:1.0:1789351200.420198:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351200.420210:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876270626409344:0@lo:400:kworker.0 00000100:00100000:1.0:1789351200.420230:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351200.420247:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626409088:0@lo:400:kworker.0 00000100:00100000:1.0:1789351200.420260:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351200.420271:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789351200.420275:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626409216:0@lo:400:kworker.0 00000100:00100000:0.0:1789351200.420384:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626408832 00000100:00100000:0.0:1789351200.420392:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626408832 00000100:00100000:0.0:1789351200.420432:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789351200.420439:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3287:x1876270626408832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351200.420834:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789351200.420841:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626409600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789351200.420918:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3287:x1876270626408832:12345-0@lo:400:kworker.0 Request processed in 479us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351200.420924:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789351200.420973:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351200.421722:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626408960 00000100:00100000:1.0:1789351200.421726:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626408960 00000100:00100000:1.0:1789351200.421751:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626409344 00000100:00100000:1.0:1789351200.421754:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626409344 00000100:00100000:1.0:1789351200.421776:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626409088 00000100:00100000:1.0:1789351200.421779:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626409088 00000100:00100000:1.0:1789351200.421795:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789351200.421802:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876270626408960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351200.421842:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876270626408960:12345-0@lo:400:kworker.0 Request processed in 41us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351200.421847:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789351200.421857:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789351200.421861:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876270626409344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351200.421880:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876270626409344:12345-0@lo:400:kworker.0 Request processed in 20us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351200.421884:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789351200.421891:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789351200.421895:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626409088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351200.421909:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626409088:12345-0@lo:400:kworker.0 Request processed in 14us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351200.421919:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789351200.421933:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626409472 00000100:00100000:1.0:1789351200.421935:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626409472 00000100:00100000:1.0:1789351200.421954:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626409216 00000100:00100000:1.0:1789351200.421957:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626409216 00000100:00100000:1.0:1789351200.421971:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789351200.421977:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626409472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351200.422006:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626409472:12345-0@lo:400:kworker.0 Request processed in 30us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351200.422010:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789351200.422018:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789351200.422023:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626409216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351200.422059:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626409216:12345-0@lo:400:kworker.0 Request processed in 36us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351200.422065:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789351200.422109:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc31a4e00 x1876270626409216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351200.422122:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626409216:0@lo:400:kworker.0 00000100:00100000:1.0:1789351200.422135:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626409088:0@lo:400:kworker.0 00000100:00100000:2.0:1789351200.423427:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789351200.423459:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789351200.423462:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789351200.423463:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789351200.423473:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626409600 00000100:00100000:2.0:1789351200.423478:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626409600 00000100:00100000:2.0:1789351200.423509:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789351200.423518:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626409600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789351200.423540:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789351200.423572:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626409600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351200.423578:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1789351200.423610:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc31d2a00 x1876270626409600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351200.423627:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626409600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789351200.426571:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626408832:0@lo:400:kworker.0 00000100:00100000:3.0:1789351200.426623:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876270626409344:0@lo:400:kworker.0 00000100:00100000:3.0:1789351200.426635:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876270626408960:0@lo:400:kworker.0 00010000:00080000:3.0:1789351200.426645:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc31a6a00 x1876270626409472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351200.426652:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626409472:0@lo:400:kworker.0 00000001:00100000:2.0:1789351200.464700:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8d53186e-ebf3-44d4-99b7-0a4ed0545c2b 00000001:00100000:2.0:1789351200.473176:0:7616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8d53186e-ebf3-44d4-99b7-0a4ed0545c2b 00000100:00100000:2.0:1789351200.555669:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351200.555724:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351200.555757:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616946944 00000100:00100000:2.0:1789351200.555767:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351200.555771:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616946944 00000100:00100000:2.0:1789351200.555805:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351200.555838:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 202 00000100:00100000:0.0:1789351200.555852:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2349:x1876270616946944:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351200.555853:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351200.555893:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616947200 00000100:00100000:2.0:1789351200.555899:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616947200 00000100:00100000:0.0:1789351200.555944:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2349:x1876270616946944:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 98us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351200.555946:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616947072 00000100:00100000:2.0:1789351200.555957:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616947072 00000100:00100000:0.0:1789351200.555962:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 202 00000100:00100000:2.0:1789351200.555989:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:2.0:1789351200.556000:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2349:x1876270616947200:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351200.556039:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2349:x1876270616947200:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 42us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351200.556058:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:2.0:1789351200.556090:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:2.0:1789351200.556099:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+6:2349:x1876270616947072:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351200.556129:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+6:2349:x1876270616947072:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 31us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351200.556136:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:2.0:1789351200.556160:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616947456 00000100:00100000:2.0:1789351200.556164:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616947456 00000100:00100000:2.0:1789351200.556197:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616947328 00000100:00100000:2.0:1789351200.556200:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616947328 00000100:00100000:2.0:1789351200.556217:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:2.0:1789351200.556224:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2349:x1876270616947456:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351200.556252:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2349:x1876270616947456:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 29us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351200.556259:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:2.0:1789351200.556271:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:2.0:1789351200.556277:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2349:x1876270616947328:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351200.556299:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2349:x1876270616947328:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 23us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351200.556305:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00080000:2.0:1789351200.556330:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789351200.556335:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789351200.556338:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789351200.737563:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789351201.408522:0:10280:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1789351201.762472:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351202.785791:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351203.490817:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789351203.490843:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626409728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789351203.490924:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351203.491031:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626409728 00000100:00100000:0.0:1789351203.491039:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626409728 00000100:00100000:0.0:1789351203.491096:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789351203.491106:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626409728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789351203.491139:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789351203.491384:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789351203.491433:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cffa13800 x1876270626409728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351203.491436:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626409728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 330us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351203.491451:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789351203.491464:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626409728:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789351203.809548:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351204.834629:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351205.538165:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876270626409984:0@lo:400:kworker.0 00000100:00100000:1.0:1789351205.538229:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626410112:0@lo:400:kworker.0 00000100:00100000:0.0:1789351205.538259:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351205.538287:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626409984 00000100:00100000:1.0:1789351205.538295:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626409984 00000100:00100000:0.0:1789351205.538318:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626410496:0@lo:400:kworker.0 00000100:00100000:1.0:1789351205.538340:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789351205.538349:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876270626409984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351205.538380:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351205.538408:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789351205.538415:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626409856:0@lo:400:kworker.0 00000100:00100000:0.0:1789351205.538443:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351205.538466:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876270626410368:0@lo:400:kworker.0 00000100:00100000:0.0:1789351205.538486:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351205.538510:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626409856 00000100:00100000:0.0:1789351205.538514:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626409856 00000100:00100000:0.0:1789351205.538542:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789351205.538557:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8339c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3287:x1876270626409856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351205.538603:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8339c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3287:x1876270626409856:12345-0@lo:400:kworker.0 Request processed in 48us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351205.538610:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789351205.538658:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626409856:0@lo:400:kworker.0 00000100:00100000:2.0:1789351205.538912:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626410240:0@lo:400:kworker.0 00000100:00100000:2.0:1789351205.538943:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351205.538989:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626410496 00000100:00100000:2.0:1789351205.538993:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626410496 00000100:00100000:2.0:1789351205.539029:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626410240 00000100:00100000:2.0:1789351205.539033:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626410240 00000100:00100000:2.0:1789351205.539050:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789351205.539057:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626410496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351205.539096:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626410496:12345-0@lo:400:kworker.0 Request processed in 39us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351205.539102:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789351205.539113:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789351205.539119:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626410240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351205.539150:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626410240:12345-0@lo:400:kworker.0 Request processed in 31us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351205.539156:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789351205.539170:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626410368 00000100:00100000:2.0:1789351205.539173:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626410368 00000100:00100000:2.0:1789351205.539194:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789351205.539302:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351205.539325:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626410624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789351205.539349:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351205.539394:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626410624 00000100:00100000:1.0:1789351205.539398:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626410624 00000100:00100000:1.0:1789351205.539436:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789351205.539442:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626410624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789351205.539471:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789351205.539505:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626410624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351205.539512:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1789351205.539515:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789351205.539520:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789351205.539522:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789351205.539529:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789351205.539536:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00010000:00080000:3.0:1789351205.539578:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cffa13800 x1876270626410496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351205.539590:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626410496:0@lo:400:kworker.0 00010000:00080000:3.0:1789351205.539616:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cffa10e00 x1876270626410240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351205.539624:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626410240:0@lo:400:kworker.0 00000100:00100000:3.0:1789351205.539644:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789351205.539649:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626410112 00000100:00100000:3.0:1789351205.539652:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626410112 00000100:00100000:1.0:1789351205.539672:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876270626409984:12345-0@lo:400:kworker.0 Request processed in 1323us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351205.539674:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789351205.539678:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789351205.539826:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789351205.539834:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626410112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351205.539868:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626410112:12345-0@lo:400:kworker.0 Request processed in 36us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351205.539873:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789351205.539894:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351205.539912:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876270626409984:0@lo:400:kworker.0 00010000:00080000:3.0:1789351205.540247:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf9ca2300 x1876270626410624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351205.540263:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626410624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789351205.540275:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626410112:0@lo:400:kworker.0 00000100:00100000:2.0:1789351205.540349:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876270626410368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351205.540411:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876270626410368:12345-0@lo:400:kworker.0 Request processed in 1211us (1923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351205.540418:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789351205.541557:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876270626410368:0@lo:400:kworker.0 00000100:00100000:3.0:1789351205.807630:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351205.807678:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351205.807710:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351205.807735:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351205.807766:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351205.807797:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616947584 00000100:00100000:3.0:1789351205.807808:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616947584 00000100:00100000:3.0:1789351205.807859:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 204 00000100:00100000:3.0:1789351205.807869:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8338c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2350:x1876270616947584:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351205.807938:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8338c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2350:x1876270616947584:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 71us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351205.807946:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 204 00000100:00100000:3.0:1789351205.807997:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616947968 00000100:00100000:3.0:1789351205.808001:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616947968 00000100:00100000:3.0:1789351205.808035:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616948096 00000100:00100000:3.0:1789351205.808038:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616948096 00000100:00100000:3.0:1789351205.808059:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:3.0:1789351205.808066:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2349:x1876270616947968:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789351205.808101:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616947712 00000100:00100000:1.0:1789351205.808107:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616947712 00000100:00100000:3.0:1789351205.808121:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2349:x1876270616947968:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 54us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351205.808130:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:1.0:1789351205.808144:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616947840 00000100:00100000:1.0:1789351205.808148:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616947840 00000100:00100000:3.0:1789351205.808152:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:3.0:1789351205.808162:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270616948096:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789351205.808179:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:1.0:1789351205.808190:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:2349:x1876270616947712:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351205.808192:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270616948096:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 30us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351205.808203:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:1.0:1789351205.808236:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:2349:x1876270616947712:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 47us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351205.808240:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:1.0:1789351205.808249:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:3.0:1789351205.808254:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270616947840:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351205.808289:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270616947840:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 40us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351205.808295:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00080000:3.0:1789351205.808688:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789351205.808694:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789351205.808696:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789351205.858257:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351206.881547:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351207.906310:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351208.609955:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626410752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789351208.610056:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351208.611468:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626410752 00000100:00100000:2.0:1789351208.611483:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626410752 00000100:00080000:0.0:1789351208.611611:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789351208.611635:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789351208.611649:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626410752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789351208.611699:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789351208.611963:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626410752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 316us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351208.611971:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789351208.612056:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf69f6d80 x1876270626410752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351208.612083:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626410752:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789351208.930751:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351209.957291:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789351210.558152:0:10980:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789351210.659156:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789351210.659185:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626410880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789351210.659256:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351210.659312:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626411008:0@lo:400:kworker.0 00000100:00100000:3.0:1789351210.659347:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351210.659348:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626411392:0@lo:400:kworker.0 00000100:00100000:3.0:1789351210.659400:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876270626411520:0@lo:400:kworker.0 00000100:00100000:2.0:1789351210.659416:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351210.659450:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351210.659454:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876270626411136:0@lo:400:kworker.0 00000100:00100000:2.0:1789351210.659487:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351210.659510:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789351210.659517:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626411264:0@lo:400:kworker.0 00000100:00100000:2.0:1789351210.659539:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351210.659729:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626411520 00000100:00100000:3.0:1789351210.659737:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626411520 00000100:00100000:2.0:1789351210.659767:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626410880 00000100:00100000:2.0:1789351210.659774:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626410880 00000100:00100000:3.0:1789351210.659790:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626411136 00000100:00100000:3.0:1789351210.659795:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626411136 00000100:00100000:3.0:1789351210.659812:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626411264 00000100:00100000:3.0:1789351210.659815:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626411264 00000100:00100000:3.0:1789351210.659830:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789351210.659839:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876270626411520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351210.659900:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876270626411520:12345-0@lo:400:kworker.0 Request processed in 61us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351210.659907:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789351210.659922:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789351210.659929:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876270626411136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351210.659968:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789351210.659970:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876270626411136:12345-0@lo:400:kworker.0 Request processed in 41us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351210.659980:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789351210.659981:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626410880:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789351210.659995:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789351210.660004:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626411264:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789351210.660014:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789351210.660033:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626411264:12345-0@lo:400:kworker.0 Request processed in 30us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351210.660048:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789351210.660059:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626410880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351210.660067:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789351210.660095:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876270626411520:0@lo:400:kworker.0 00000100:00100000:2.0:1789351210.660114:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626411392 00010000:00080000:3.0:1789351210.660115:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf9ca0380 x1876270626410880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351210.660131:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626410880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789351210.660188:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626411392 00000100:00100000:2.0:1789351210.660225:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789351210.660233:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626411392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351210.660280:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626411392:12345-0@lo:400:kworker.0 Request processed in 47us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351210.660288:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789351210.660326:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf9d8e300 x1876270626411392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351210.660338:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626411392:0@lo:400:kworker.0 00000100:00100000:2.0:1789351210.660388:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626411264:0@lo:400:kworker.0 00000100:00100000:2.0:1789351210.660400:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876270626411136:0@lo:400:kworker.0 00000100:00080000:3.0:1789351210.662329:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789351210.662336:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789351210.662338:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351210.662352:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626411008 00000100:00100000:3.0:1789351210.662378:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626411008 00000100:00100000:3.0:1789351210.662427:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789351210.662439:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3287:x1876270626411008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351210.662514:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3287:x1876270626411008:12345-0@lo:400:kworker.0 Request processed in 78us (3168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351210.662520:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789351210.662578:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626411008:0@lo:400:kworker.0 00000100:00100000:1.0:1789351210.929616:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351210.929695:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351210.929734:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351210.929756:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351210.929794:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616948608 00000100:00100000:0.0:1789351210.929805:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616948608 00000100:00100000:1.0:1789351210.929838:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351210.929865:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616948224 00000100:00100000:1.0:1789351210.929869:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616948224 00000100:00100000:0.0:1789351210.929872:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616948736 00000100:00100000:0.0:1789351210.929888:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616948736 00000100:00100000:1.0:1789351210.929919:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 206 00000100:00100000:0.0:1789351210.929928:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:1.0:1789351210.929934:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2350:x1876270616948224:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351210.929943:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270616948608:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351210.930015:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270616948608:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 76us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351210.930016:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2350:x1876270616948224:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 86us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351210.930033:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 206 00000100:00100000:0.0:1789351210.930033:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:0.0:1789351210.930057:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:0.0:1789351210.930066:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270616948736:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351210.930091:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270616948736:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 27us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351210.930097:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00080000:0.0:1789351210.930114:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789351210.930119:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789351210.930220:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616948352 00000100:00100000:3.0:1789351210.930225:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616948352 00000100:00080000:0.0:1789351210.930252:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351210.930266:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616948480 00000100:00100000:3.0:1789351210.930270:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616948480 00000100:00100000:3.0:1789351210.930302:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:3.0:1789351210.930309:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+6:2350:x1876270616948352:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351210.930343:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+6:2350:x1876270616948352:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 34us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351210.930350:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00080000:0.0:1789351210.930353:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351210.930407:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:3.0:1789351210.930414:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270616948480:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351210.930439:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270616948480:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 25us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351210.930444:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00010000:00010000:0.0:1789351210.977559:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351212.004294:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789351212.709167:0:11129:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf45d8550 20000000:00000080:1.0:1789351212.709192:0:11129:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2d009cf000 uarg=0000000000000000 20000000:01000000:1.0:1789351212.709238:0:11129:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789351212.709245:0:11129:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789351212.709251:0:11129:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789351212.714694:0:11130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789351212.716992:0:11129:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789351212.727212:0:11129:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789351212.727261:0:11129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6ccb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351212.727289:0:11129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bca expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351212.727299:0:11129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ceecd9400/0xa6ea017771df6c38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6c31 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351212.727307:0:11129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d021c4200/0xa6ea017771df6c62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6c5b expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351212.727313:0:11129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6c8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6c85 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351212.727317:0:11129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ceecd9a00/0xa6ea017771df6caf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c02 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351212.727344:0:11129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6ccb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.727594:0:11129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ceecd9a00/0xa6ea017771df6caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c02 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.727616:0:11129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2ceecd9a00/0xa6ea017771df6caf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c02 expref: 12 pid: 5816 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351212.727653:0:11129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d05f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11129:1876270626411648:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351212.727785:0:11129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6c8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6c85 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.727795:0:11129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6c8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6c85 expref: 18 pid: 5814 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351212.727806:0:11129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d06680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11129:1876270626411776:0@lo:104: 00000100:00100000:1.0:1789351212.727862:0:11129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789351212.727915:0:11129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d021c4200/0xa6ea017771df6c62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6c5b expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.727924:0:11129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2d021c4200/0xa6ea017771df6c62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6c5b expref: 18 pid: 5814 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351212.727931:0:11129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d05180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11129:1876270626411904:0@lo:104: 00000100:00100000:0.0:1789351212.727994:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626411776 00000100:00100000:0.0:1789351212.728007:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626411776 00000100:00100000:0.0:1789351212.728074:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789351212.728084:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+3:11129:x1876270626411776:12345-0@lo:104: 00010000:00010000:0.0:1789351212.728100:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd9800/0xa6ea017771df6c85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6c8c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351212.730142:0:11129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789351212.730216:0:11129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ceecd9400/0xa6ea017771df6c38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6c31 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.730229:0:11129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2ceecd9400/0xa6ea017771df6c38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6c31 expref: 18 pid: 5816 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351212.730242:0:11129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d07800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11129:1876270626412032:0@lo:104: 00000100:00100000:1.0:1789351212.730276:0:11129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789351212.730313:0:11129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bca expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.730342:0:11129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bca expref: 12 pid: 5816 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351212.730380:0:11129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11129:1876270626412160:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351212.730398:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626411904 00000100:00100000:3.0:1789351212.730411:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626411904 00000100:00100000:3.0:1789351212.730471:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626412032 00000100:00100000:3.0:1789351212.730483:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626412032 00000100:00100000:3.0:1789351212.730516:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789351212.730528:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f7166352-9951-4386-a0b0-6dc1f552d00a+5:11129:x1876270626411904:12345-0@lo:104: 00010000:00010000:3.0:1789351212.730546:0:7614:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4000/0xa6ea017771df6c5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6c62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351212.730639:0:11129:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf7268840 going to sleep for 11 seconds 00000100:00100000:1.0:1789351212.730671:0:11129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d06680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11129:1876270626411776:0@lo:104: 00010000:00010000:0.0:1789351212.730671:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789351212.730679:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789351212.730686:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+5:11129:x1876270626411776:12345-0@lo:104: Request processed in 2601us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351212.730696:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:f7166352-9951-4386-a0b0-6dc1f552d00a+5:11129:x1876270626412032:12345-0@lo:104: 00000100:00100000:0.0:1789351212.730696:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789351212.730698:0:11129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d05180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11129:1876270626411904:0@lo:104: 00010000:00010000:2.0:1789351212.730715:0:8416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931e00/0xa6ea017771df6c31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6c38 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351212.731519:0:11129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d07800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11129:1876270626412032:0@lo:104: 00010000:00010000:1.0:1789351212.731794:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789351212.731800:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd9800/0xa6ea017771df6c85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6c8c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.731809:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9800 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:1.0:1789351212.731812:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd9800/0xa6ea017771df6c85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6c8c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.731820:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd9800/0xa6ea017771df6c85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6c8c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789351212.731825:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd9800/0xa6ea017771df6c85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6c8c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351212.731829:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789351212.731874:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd9800/0xa6ea017771df6c85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6c8c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.731879:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789351212.731917:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd9800/0xa6ea017771df6c85 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6c8c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.731922:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd9800/0xa6ea017771df6c85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6c8c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.731935:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789351212.731937:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4000/0xa6ea017771df6c5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6c62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.731941:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c4000 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:1.0:1789351212.731943:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4000/0xa6ea017771df6c5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6c62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.731947:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4000/0xa6ea017771df6c5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6c62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789351212.731951:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4000/0xa6ea017771df6c5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6c62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351212.731955:0:7614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:1.0:1789351212.731956:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789351212.731974:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f7166352-9951-4386-a0b0-6dc1f552d00a+4:11129:x1876270626411904:12345-0@lo:104: Request processed in 1443us (1833us total) trans 0 rc 0/0 00010000:00010000:1.0:1789351212.731981:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4000/0xa6ea017771df6c5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6c62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351212.731992:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1789351212.731992:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789351212.732003:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4000/0xa6ea017771df6c5b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6c62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.732008:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4000/0xa6ea017771df6c5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6c62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.732020:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789351212.732027:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931e00/0xa6ea017771df6c31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6c38 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.732032:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cd5931e00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:1.0:1789351212.732035:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931e00/0xa6ea017771df6c31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6c38 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.732039:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931e00/0xa6ea017771df6c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6c38 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789351212.732043:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931e00/0xa6ea017771df6c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6c38 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351212.732046:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789351212.732057:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931e00/0xa6ea017771df6c31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6c38 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.732060:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789351212.732078:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931e00/0xa6ea017771df6c31 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6c38 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.732082:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931e00/0xa6ea017771df6c31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6c38 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.732092:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351212.732093:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351212.732095:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351212.732221:0:11129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d05f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11129:1876270626411648:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789351212.732513:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351212.733527:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626412544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789351212.733605:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351212.733674:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626412544 00000100:00100000:1.0:1789351212.733687:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626412544 00000100:00100000:0.0:1789351212.733707:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626412416:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351212.733729:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ceecd9400/0xa6ea017771df6c38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6c31 expref: 19 pid: 5816 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351212.733740:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351212.733767:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789351212.733777:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626412288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789351212.733803:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351212.733843:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626412416 00000100:00100000:1.0:1789351212.733857:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626412288 00000100:00100000:0.0:1789351212.733862:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626412416 00000100:00100000:1.0:1789351212.733864:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626412288 00010000:00010000:0.0:1789351212.733908:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d021c4200/0xa6ea017771df6c62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6c5b expref: 21 pid: 5814 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.733917:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6c8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6c85 expref: 21 pid: 5814 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351212.733953:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789351212.734186:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351212.734278:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351212.734304:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616948864 00000100:00100000:3.0:1789351212.734308:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616948864 00010000:00010000:3.0:1789351212.734331:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ceecd9a00/0xa6ea017771df6caf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c02 expref: 13 pid: 5816 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351212.734399:0:8416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789351212.734411:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:f7166352-9951-4386-a0b0-6dc1f552d00a+3:11129:x1876270626412032:12345-0@lo:104: Request processed in 3717us (4131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351212.734421:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789351212.734452:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351212.735084:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+21:3286:x1876270626412544:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789351212.735115:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789351212.735132:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7166352-9951-4386-a0b0-6dc1f552d00a+21:3289:x1876270626412416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351212.735150:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351212.735159:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d021c4200/0xa6ea017771df6c62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6c5b expref: 21 pid: 5814 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351212.735159:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351212.735174:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ceecd9400/0xa6ea017771df6c38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6c31 expref: 21 pid: 5816 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.735177:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d021c4200/0xa6ea017771df6c62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6c5b expref: 21 pid: 5814 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.735212:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d021c4200/0xa6ea017771df6c62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6c5b expref: 21 pid: 5814 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.735227:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789351212.735267:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ceecd9400/0xa6ea017771df6c38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6c31 expref: 20 pid: 5816 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351212.735287:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ceecd9400/0xa6ea017771df6c38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6c31 expref: 20 pid: 5816 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351212.735296:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7166352-9951-4386-a0b0-6dc1f552d00a+20:3289:x1876270626412416:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351212.735310:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789351212.735316:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351212.735336:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616948992 00000100:00100000:1.0:1789351212.735341:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616948992 00010000:00010000:1.0:1789351212.735387:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c0e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bca expref: 14 pid: 5816 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351212.735413:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789351212.735421:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7166352-9951-4386-a0b0-6dc1f552d00a+18:3289:x1876270626412288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351212.735449:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351212.735456:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6c8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6c85 expref: 18 pid: 5814 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351212.735470:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626412416:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351212.735471:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6c8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6c85 expref: 18 pid: 5814 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.735500:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6c8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6c85 expref: 18 pid: 5814 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.735509:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351212.735541:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7166352-9951-4386-a0b0-6dc1f552d00a+17:3289:x1876270626412288:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351212.735546:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789351212.735568:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:2.0:1789351212.735572:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626412288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789351212.735581:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+16:3286:x1876270626412544:12345-0@lo:103:ldlm_bl.0 Request processed in 500us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351212.735587:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:038b9b38-b2ec-45ac-958b-dad437feb5c7+14:2348:x1876270616948992:12345-192.168.201.52@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789351212.735613:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789351212.735617:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351212.735622:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c0e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bca expref: 14 pid: 5816 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.735629:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bca expref: 14 pid: 5816 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.735638:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351212.735685:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626412544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789351212.735687:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:038b9b38-b2ec-45ac-958b-dad437feb5c7+14:2348:x1876270616948992:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 109us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351212.735702:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00010000:00010000:1.0:1789351212.735764:0:11129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cd5931800/0xa6ea017771df6c0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bca expref: 13 pid: 5816 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351212.735778:0:11129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11129:1876270626412160:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351212.735815:0:11129:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6ccb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351212.736389:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:3.0:1789351212.736406:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc312f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:2347:x1876270616948864:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351212.736421:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351212.736441:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ceecd9a00/0xa6ea017771df6caf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c02 expref: 12 pid: 5816 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351212.736454:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ceecd9a00/0xa6ea017771df6caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c02 expref: 12 pid: 5816 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351212.736470:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ceecd9a00/0xa6ea017771df6caf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c02 expref: 12 pid: 5816 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351212.736486:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6ccb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351212.736496:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6ccb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351212.736670:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6ccb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351212.736679:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6ccb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351212.736686:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6ccb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351212.736694:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6ccb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351212.736701:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f78000 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351212.736706:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6ccb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351212.736715:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6ccb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351212.736753:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6ccb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351212.736767:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351212.736834:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc312f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:2347:x1876270616948864:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 434us (2649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351212.736841:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00010000:00010000:1.0:1789351212.736956:0:11129:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6ccb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.736966:0:11129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6ccb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351212.736973:0:11129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cf0f78000/0xa6ea017771df6ccb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351213.025676:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351213.729597:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626412672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789351213.729702:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351213.729750:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626412672 00000100:00100000:2.0:1789351213.729762:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626412672 00000100:00080000:0.0:1789351213.729802:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789351213.729845:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789351213.729859:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626412672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789351213.729906:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789351213.729972:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626412672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351213.729981:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789351213.730028:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf69f4700 x1876270626412672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351213.730051:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626412672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789351213.933589:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351213.933679:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616949120 00000100:00100000:0.0:1789351213.933690:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616949120 00000100:00100000:0.0:1789351213.933744:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 207 00000100:00100000:0.0:1789351213.933754:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:5583:x1876270616949120:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789351213.933771:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351213.933790:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecd8000/0xa6ea017771df6cd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c2c expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351213.933895:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecd8000/0xa6ea017771df6cd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c2c expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351213.933910:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecd8000/0xa6ea017771df6cd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c2c expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351213.933920:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8000, rc 0) 00000100:00100000:0.0:1789351213.934018:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:5583:x1876270616949120:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 266us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351213.934025:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 207 00000100:00100000:1.0:1789351213.939319:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351213.939355:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616949248 00000100:00100000:1.0:1789351213.939381:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616949248 00000100:00100000:1.0:1789351213.939427:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 208 00000100:00100000:1.0:1789351213.939437:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:5583:x1876270616949248:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351213.939689:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:5583:x1876270616949248:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 252us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351213.939696:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 208 00000100:00100000:3.0:1789351213.942723:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351213.942757:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616949376 00000100:00100000:3.0:1789351213.942765:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616949376 00000100:00100000:3.0:1789351213.942809:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 209 00000100:00100000:3.0:1789351213.942817:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:5583:x1876270616949376:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789351213.943574:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:5583:x1876270616949376:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 755us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351213.943584:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 209 00000100:00100000:1.0:1789351213.952895:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351213.952972:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616949504 00000100:00100000:2.0:1789351213.952982:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616949504 00000100:00100000:2.0:1789351213.953046:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 210 00000100:00100000:2.0:1789351213.953056:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:5583:x1876270616949504:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789351213.953074:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351213.953092:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cf0f79800/0xa6ea017771df6cd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c33 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351213.953123:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cf0f79800/0xa6ea017771df6cd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c33 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351213.953135:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cf0f79800/0xa6ea017771df6cd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c33 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351213.953146:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cf0f79800, rc 0) 00000100:00100000:2.0:1789351213.953205:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:5583:x1876270616949504:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 150us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351213.953213:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 210 00000100:00100000:1.0:1789351213.954810:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351213.954912:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616949632 00000100:00100000:3.0:1789351213.954920:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616949632 00000100:00100000:3.0:1789351213.954968:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 211 00000100:00100000:3.0:1789351213.954976:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:5583:x1876270616949632:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789351213.955239:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:5583:x1876270616949632:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 262us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351213.955247:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 211 00000100:00100000:3.0:1789351213.958010:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351213.958117:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616949760 00000100:00100000:1.0:1789351213.958130:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616949760 00000100:00100000:1.0:1789351213.958471:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 212 00000100:00100000:1.0:1789351213.958491:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:5583:x1876270616949760:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351213.958698:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:5583:x1876270616949760:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 208us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351213.958706:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 212 00010000:00010000:0.0:1789351214.049712:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789351214.626516:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789351214.626528:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2cc5aa8000 from 7 10000000:01000000:3.0:1789351214.626536:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789351214.626603:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6ce0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351214.626617:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6ce0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351214.626630:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6ce0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351214.626663:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9ca1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626412800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789351214.626843:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351214.626980:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626412800 00000100:00100000:1.0:1789351214.626990:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626412800 00000100:00100000:3.0:1789351214.627050:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc31d6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351214.631571:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789351214.631599:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626412800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789351214.631625:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351214.631652:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cd5930200/0xa6ea017771df6ce7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6ce0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351214.631690:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cd5930200/0xa6ea017771df6ce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6ce0 expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351214.631702:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cd5930200/0xa6ea017771df6ce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6ce0 expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351214.631714:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cd5930200, rc 0) 00000100:00100000:1.0:1789351214.631951:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626412800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 365us (5107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351214.631959:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789351214.632076:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9ca1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626412800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789351214.632101:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6ce0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6ce7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351214.632113:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6ce0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6ce7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351214.632209:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9ca1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626412928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789351214.632248:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351214.632293:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc31d6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351214.632541:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626412928 00000100:00100000:1.0:1789351214.632549:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626412928 00000100:00100000:1.0:1789351214.632589:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789351214.632597:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626412928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351214.633093:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626412928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 495us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351214.633109:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789351214.633956:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9ca1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626412928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789351214.634018:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9ca1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626413056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789351214.634087:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351214.634175:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc31d6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351214.636106:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626413056 00000100:00100000:1.0:1789351214.636123:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626413056 00000100:00100000:1.0:1789351214.636198:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789351214.636210:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626413056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351214.636668:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626413056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 459us (2579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351214.636678:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789351214.636844:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9ca1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626413056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789351214.637891:0:11270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789351214.638124:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789351214.638169:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789351214.638183:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6ce0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6ce7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351214.638198:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6ce0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6ce7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351214.638211:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789351214.638214:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2cf76fd000 from 7 10000000:01000000:2.0:1789351214.638218:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789351214.638264:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78000/0xa6ea017771df6cee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351214.638295:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78000/0xa6ea017771df6cee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351214.638309:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78000/0xa6ea017771df6cee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351214.638339:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626413184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789351214.638442:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351214.638484:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cffa713c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351214.638589:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626413184 00000100:00100000:1.0:1789351214.638597:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626413184 00000100:00100000:1.0:1789351214.638651:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789351214.638661:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626413184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789351214.638676:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351214.638691:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cd5931e00/0xa6ea017771df6cf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6cee expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351214.638792:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cd5931e00/0xa6ea017771df6cf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6cee expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351214.638807:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cd5931e00/0xa6ea017771df6cf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6cee expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351214.638829:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cd5931e00, rc 0) 00000100:00100000:1.0:1789351214.638890:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626413184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351214.638897:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789351214.638992:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626413184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789351214.639008:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78000/0xa6ea017771df6cee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6cf5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351214.639017:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78000/0xa6ea017771df6cee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6cf5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351214.639082:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626413312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351214.639109:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351214.639132:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789351214.639176:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626413312 00000100:00100000:2.0:1789351214.639180:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626413312 00000100:00100000:2.0:1789351214.639215:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789351214.639223:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626413312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789351214.639813:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626413312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 588us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351214.639829:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789351214.641349:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626413312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351214.641435:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626413440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789351214.641516:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351214.641610:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757b300 going to sleep for 11 seconds 00000100:00100000:1.0:1789351214.644944:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626413440 00000100:00100000:1.0:1789351214.644982:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626413440 00000100:00100000:1.0:1789351214.645382:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789351214.645396:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626413440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351214.645715:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626413440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 320us (4196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351214.645801:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789351214.645998:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626413440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789351214.646945:0:11272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789351214.647170:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789351214.647193:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789351214.647207:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78000/0xa6ea017771df6cee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6cf5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351214.647221:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78000/0xa6ea017771df6cee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6cf5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351214.647235:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789351214.647238:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2cc5fed000 from 7 10000000:01000000:0.0:1789351214.647242:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789351214.647288:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8200/0xa6ea017771df6cfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351214.647296:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8200/0xa6ea017771df6cfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351214.647308:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8200/0xa6ea017771df6cfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351214.647335:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626413568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789351214.647530:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351214.647613:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757b300 going to sleep for 11 seconds 00000100:00100000:1.0:1789351214.647618:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626413568 00000100:00100000:1.0:1789351214.647627:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626413568 00000100:00100000:1.0:1789351214.647678:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789351214.647690:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626413568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789351214.647705:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351214.647735:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6d03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6cfc expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351214.647766:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6cfc expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351214.647779:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6cfc expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351214.647790:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cd5931c00, rc 0) 00000100:00100000:1.0:1789351214.647852:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:5820:x1876270626413568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351214.647861:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789351214.647876:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626413568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789351214.647893:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8200/0xa6ea017771df6cfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6d03 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351214.647903:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8200/0xa6ea017771df6cfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6d03 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351214.647963:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626413696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351214.647996:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351214.648017:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789351214.648054:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626413696 00000100:00100000:2.0:1789351214.648059:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626413696 00000100:00100000:2.0:1789351214.648200:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789351214.648209:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:5820:x1876270626413696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789351214.648549:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:5820:x1876270626413696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 341us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351214.648558:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789351214.648672:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626413696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351214.648703:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626413824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351214.648747:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351214.648867:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf7268300 going to sleep for 11 seconds 00000100:00100000:0.0:1789351214.649646:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626413824 00000100:00100000:0.0:1789351214.649657:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626413824 00000100:00100000:0.0:1789351214.649705:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789351214.649776:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:5820:x1876270626413824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789351214.650067:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:5820:x1876270626413824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 353us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351214.650077:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789351214.650504:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626413824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789351214.651221:0:11273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789351214.651279:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789351214.651299:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789351214.651312:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8200/0xa6ea017771df6cfc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6d03 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351214.651323:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8200/0xa6ea017771df6cfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6d03 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351215.074607:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789351215.090877:0:11326:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789351215.777985:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876270626414208:0@lo:400:kworker.0 00000100:00100000:2.0:1789351215.778077:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876270626414080:0@lo:400:kworker.0 00000100:00100000:0.0:1789351215.778086:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351215.778157:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626413952:0@lo:400:kworker.0 00000100:00100000:2.0:1789351215.778283:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351215.778309:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789351215.778313:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626414592:0@lo:400:kworker.0 00000100:00100000:0.0:1789351215.778320:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626414336:0@lo:400:kworker.0 00000100:00100000:2.0:1789351215.778350:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351215.778386:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789351215.778391:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626414208 00000100:00100000:1.0:1789351215.778402:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626414208 00000100:00100000:0.0:1789351215.778414:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626414720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789351215.778447:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351215.778470:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626414080 00000100:00100000:1.0:1789351215.778474:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626414080 00000100:00100000:0.0:1789351215.778485:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626414592 00000100:00100000:0.0:1789351215.778490:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626414592 00000100:00100000:1.0:1789351215.778502:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789351215.778515:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876270626414208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351215.778530:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789351215.778540:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626414592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351215.778592:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876270626414208:12345-0@lo:400:kworker.0 Request processed in 74us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351215.778601:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789351215.778619:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789351215.778625:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876270626414080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351215.778654:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876270626414080:12345-0@lo:400:kworker.0 Request processed in 29us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351215.778659:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1789351215.778716:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789351215.778721:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789351215.778731:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351215.778771:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876270626414208:0@lo:400:kworker.0 00000100:00100000:1.0:1789351215.778814:0:6663:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789351215.778824:0:6663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789351215.778848:0:6660:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789351215.778854:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626414336 00000100:00100000:1.0:1789351215.778857:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626414336 00000100:00100000:1.0:1789351215.778879:0:6660:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789351215.778885:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789351215.778891:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626414336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351215.778924:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626414336:12345-0@lo:400:kworker.0 Request processed in 33us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351215.778938:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789351215.778950:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789351215.778969:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf69f5f80 x1876270626414336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351215.778980:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626414336:0@lo:400:kworker.0 00000100:00100000:2.0:1789351215.779060:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876270626414080:0@lo:400:kworker.0 00010000:00080000:2.0:1789351215.779070:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf69f6300 x1876270626414592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351215.779077:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626414592:0@lo:400:kworker.0 00000100:00100000:1.0:1789351215.779206:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626414720 00000100:00100000:1.0:1789351215.779211:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626414720 00000100:00100000:1.0:1789351215.779240:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789351215.779247:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1876270626414720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789351215.779279:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789351215.779319:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1876270626414720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351215.779325:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789351215.779394:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc31a4e00 x1876270626414720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351215.779413:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626414720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789351215.779413:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626414592:12345-0@lo:400:kworker.0 Request processed in 52us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351215.779426:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789351215.779522:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351215.779561:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626414464:0@lo:400:kworker.0 00000100:00100000:3.0:1789351215.779600:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351215.779646:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626414464 00000100:00100000:3.0:1789351215.779650:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626414464 00000100:00100000:3.0:1789351215.779684:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789351215.779693:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876270626414464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351215.779731:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876270626414464:12345-0@lo:400:kworker.0 Request processed in 41us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351215.779738:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1789351215.779752:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351215.779769:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626414464:0@lo:400:kworker.0 00000100:00100000:1.0:1789351215.779856:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626413952 00000100:00100000:1.0:1789351215.779860:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626413952 00000100:00100000:1.0:1789351215.779901:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789351215.779908:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3288:x1876270626413952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351215.779951:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3288:x1876270626413952:12345-0@lo:400:kworker.0 Request processed in 43us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351215.779959:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789351215.780057:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626413952:0@lo:400:kworker.0 00000100:00100000:1.0:1789351216.048219:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351216.048269:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351216.048387:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616949888 00000100:00100000:2.0:1789351216.048397:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616949888 00000100:00100000:2.0:1789351216.048457:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 223 00000100:00100000:2.0:1789351216.048467:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2350:x1876270616949888:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351216.048543:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2350:x1876270616949888:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 77us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351216.048550:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 223 00000100:00100000:1.0:1789351216.049461:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351216.049486:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351216.049544:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616950400 00000100:00100000:2.0:1789351216.049551:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616950400 00000100:00100000:2.0:1789351216.049607:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:2.0:1789351216.049615:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270616950400:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351216.049658:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270616950400:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 44us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351216.049665:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00080000:0.0:1789351216.051119:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789351216.054431:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616950144 00000100:00100000:2.0:1789351216.054431:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616950016 00000100:00100000:3.0:1789351216.054444:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616950144 00000100:00100000:2.0:1789351216.054451:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616950016 00000100:00100000:3.0:1789351216.054558:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:0.0:1789351216.054560:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351216.054567:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:3.0:1789351216.054573:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270616950144:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351216.054582:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+6:2350:x1876270616950016:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351216.054603:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616950272 00000100:00100000:0.0:1789351216.054608:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616950272 00000100:00080000:1.0:1789351216.054632:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789351216.054638:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789351216.054642:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:2.0:1789351216.054649:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+6:2350:x1876270616950016:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 71us (5160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351216.054655:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270616950272:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351216.054662:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:3.0:1789351216.054720:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270616950144:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 153us (6450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351216.054728:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:0.0:1789351216.057458:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270616950272:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 2797us (2894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351216.057474:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00010000:00010000:1.0:1789351216.097995:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351217.121608:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789351217.337468:0:11426:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:00:16 (1789351216) === 00000100:00100000:2.0:1789351217.451124:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351217.451801:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616950528 00000100:00100000:0.0:1789351217.451812:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616950528 00000100:00100000:0.0:1789351217.451870:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:0.0:1789351217.451881:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8237986d-b9e8-417a-ac8f-a078390d268c+6:9666:x1876270616950528:12345-192.168.201.52@tcp:700:mkdir.0 00000100:00100000:0.0:1789351217.451963:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8237986d-b9e8-417a-ac8f-a078390d268c+6:9666:x1876270616950528:12345-192.168.201.52@tcp:700:mkdir.0 Request processed in 83us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351217.451971:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1789351217.457965:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351217.459889:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616950784 00000100:00100000:2.0:1789351217.459902:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616950784 00000100:00100000:2.0:1789351217.459963:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:2.0:1789351217.460072:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+6:9666:x1876270616950784:12345-192.168.201.52@tcp:36:mkdir.0 00010000:00010000:2.0:1789351217.460132:0:10562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351217.460201:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df6b7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bb5 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.460220:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce058fe00) 00010000:00010000:2.0:1789351217.460230:0:10562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351217.461066:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78800/0xa6ea017771df6d0a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.461081:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78800/0xa6ea017771df6d0a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.461091:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78800/0xa6ea017771df6d0a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.461126:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d11 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.461145:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d11 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.461152:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d11 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351217.462377:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789351217.462391:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78800/0xa6ea017771df6d0a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.462398:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78800/0xa6ea017771df6d0a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.462406:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78800/0xa6ea017771df6d0a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.462413:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f78800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351217.462418:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78800/0xa6ea017771df6d0a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.462425:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78800/0xa6ea017771df6d0a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.462438:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351217.462441:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351217.462445:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78800/0xa6ea017771df6d0a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.462451:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78800/0xa6ea017771df6d0a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789351217.462479:0:10562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d48a7b9 reply state 00000000fbf05d71 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d11 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351217.462488:0:10562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789351217.462599:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+7:9666:x1876270616950784:12345-192.168.201.52@tcp:36:mkdir.0 Request processed in 2623us (4640us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789351217.462607:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00010000:00010000:3.0:1789351217.469220:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d11 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.469242:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d11 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.469253:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d11 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.469260:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f79000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351217.469264:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d11 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.469272:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d11 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.469292:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d2ce9e1ab00) 00010000:00010000:3.0:1789351217.469294:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351217.469299:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d11 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.469306:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d11 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351217.472532:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351217.472683:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616950912 00000100:00100000:3.0:1789351217.472695:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616950912 00000100:00100000:3.0:1789351217.472742:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:3.0:1789351217.472752:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+6:9667:x1876270616950912:12345-192.168.201.52@tcp:101:chmod.0 00010000:00010000:3.0:1789351217.472785:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351217.472814:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df6d18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c3a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.473566:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931200/0xa6ea017771df6d1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.473582:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931200/0xa6ea017771df6d1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.473593:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931200/0xa6ea017771df6d1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351217.473641:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789351217.473644:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789351217.473669:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931200/0xa6ea017771df6d1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.473690:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df6d18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c3a expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.473702:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931200/0xa6ea017771df6d1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c3a expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.473708:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce058f700) 00010000:00010000:1.0:1789351217.473710:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789351217.473712:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cd5931200, rc 0) 00000100:00100000:1.0:1789351217.473770:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+7:9667:x1876270616950912:12345-192.168.201.52@tcp:101:chmod.0 Request processed in 1019us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351217.473786:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:1.0:1789351217.475585:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351217.475622:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616951168 00000100:00100000:3.0:1789351217.475631:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616951168 00000100:00100000:3.0:1789351217.475681:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:3.0:1789351217.475691:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+7:9667:x1876270616951168:12345-192.168.201.52@tcp:36:chmod.0 00010000:00010000:3.0:1789351217.475737:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351217.475758:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931200/0xa6ea017771df6d1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c3a expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.475783:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce058f700) 00010000:00010000:3.0:1789351217.475793:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351217.475813:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4a00/0xa6ea017771df6d26 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.475822:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4a00/0xa6ea017771df6d26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.475829:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4a00/0xa6ea017771df6d26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789351217.476512:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3e9b7c3 reply state 0000000050f9c13a transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4a00/0xa6ea017771df6d26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351217.476521:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789351217.476534:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1789351217.476615:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+8:9667:x1876270616951168:12345-192.168.201.52@tcp:36:chmod.0 Request processed in 925us (1033us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789351217.476622:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00010000:00010000:3.0:1789351217.479086:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4a00/0xa6ea017771df6d26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.479108:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4a00/0xa6ea017771df6d26 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.479117:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4a00/0xa6ea017771df6d26 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.479124:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c4a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351217.479129:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4a00/0xa6ea017771df6d26 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.479136:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4a00/0xa6ea017771df6d26 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.479157:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce058f200) 00010000:00010000:3.0:1789351217.479160:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789351217.479166:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4a00/0xa6ea017771df6d26 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.479173:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4a00/0xa6ea017771df6d26 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351217.504584:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351217.504666:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616951296 00000100:00100000:2.0:1789351217.504680:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616951296 00000100:00100000:2.0:1789351217.504869:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:2.0:1789351217.504880:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+7:9668:x1876270616951296:12345-192.168.201.52@tcp:101:chown.0 00010000:00010000:2.0:1789351217.504906:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351217.504930:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78800/0xa6ea017771df6d2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c41 expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.505003:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.505016:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.505029:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351217.505088:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1789351217.505091:0:10562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351217.505127:0:10562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.505170:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78800/0xa6ea017771df6d2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c41 expref: 9 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.505189:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c41 expref: 8 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.505195:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351217.505197:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789351217.505200:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cf0f79000, rc 0) 00000100:00100000:2.0:1789351217.505321:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+8:9668:x1876270616951296:12345-192.168.201.52@tcp:101:chown.0 Request processed in 442us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351217.505328:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:1.0:1789351217.510466:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351217.510646:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616951424 00000100:00100000:2.0:1789351217.510659:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616951424 00000100:00100000:2.0:1789351217.510717:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:2.0:1789351217.510728:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+8:9668:x1876270616951424:12345-192.168.201.52@tcp:101:chown.0 00010000:00010000:2.0:1789351217.510748:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351217.510768:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78800/0xa6ea017771df6d3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c48 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.510853:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78c00/0xa6ea017771df6d42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.510866:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78c00/0xa6ea017771df6d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.510877:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78c00/0xa6ea017771df6d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.510919:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1600/0xa6ea017771df6d49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.510926:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1600/0xa6ea017771df6d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.510933:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1600/0xa6ea017771df6d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511034:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df6d50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511042:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df6d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511049:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df6d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351217.511084:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789351217.511089:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351217.511112:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df6d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511124:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78c00/0xa6ea017771df6d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511131:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78c00/0xa6ea017771df6d42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511138:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78c00/0xa6ea017771df6d42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511155:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f78c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351217.511160:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78c00/0xa6ea017771df6d42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511167:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78c00/0xa6ea017771df6d42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511179:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351217.511182:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351217.511186:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78c00/0xa6ea017771df6d42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511192:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78c00/0xa6ea017771df6d42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511204:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1600/0xa6ea017771df6d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511209:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1600/0xa6ea017771df6d49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511215:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1600/0xa6ea017771df6d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511220:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351217.511222:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1600/0xa6ea017771df6d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511228:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1600/0xa6ea017771df6d49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511251:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d2ce9e1a200) 00010000:00010000:2.0:1789351217.511253:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351217.511255:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1600/0xa6ea017771df6d49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511259:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1600/0xa6ea017771df6d49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511282:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78800/0xa6ea017771df6d3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c48 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511290:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df6d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c48 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.511295:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:2.0:1789351217.511296:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789351217.511298:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0e00, rc 0) 00000100:00100000:2.0:1789351217.511347:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+9:9668:x1876270616951424:12345-192.168.201.52@tcp:101:chown.0 Request processed in 622us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351217.511351:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:1.0:1789351217.514626:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351217.514751:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616951680 00000100:00100000:0.0:1789351217.514760:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616951680 00000100:00100000:0.0:1789351217.514827:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:0.0:1789351217.514840:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+9:9668:x1876270616951680:12345-192.168.201.52@tcp:36:chown.0 00010000:00010000:0.0:1789351217.514894:0:9467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351217.514922:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df6d50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c48 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.514945:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:0.0:1789351217.514954:0:9467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789351217.514976:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6d57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.514988:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6d57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.514998:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6d57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789351217.549273:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1789351217.549379:0:9467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e5dceff reply state 000000009d9e53bf transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6d57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351217.549394:0:9467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789351217.549650:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1789351217.549880:0:9467:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789351217.549900:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+7:9668:x1876270616951680:12345-192.168.201.52@tcp:36:chown.0 Request processed in 35059us (35277us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789351217.549908:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00010000:00010000:3.0:1789351217.550233:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6d57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.550252:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6d57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.550260:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6d57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.550284:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351217.550289:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6d57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.550964:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6d57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.550985:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2cc886e500) 00010000:00010000:3.0:1789351217.550989:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789351217.550994:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6d57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.551000:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6d57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351217.563298:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351217.563954:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616951808 00000100:00100000:2.0:1789351217.563969:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616951808 00000100:00100000:2.0:1789351217.564054:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:2.0:1789351217.564068:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+6:9669:x1876270616951808:12345-192.168.201.52@tcp:101:touch.500 00010000:00010000:2.0:1789351217.564101:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351217.564128:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1600/0xa6ea017771df6d5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c4f expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789351217.564993:0:10562:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 762us 00010000:00010000:1.0:1789351217.576819:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5930a00/0xa6ea017771df6d65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.576847:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5930a00/0xa6ea017771df6d65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.576864:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5930a00/0xa6ea017771df6d65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.576884:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931200/0xa6ea017771df6d6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.576891:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931200/0xa6ea017771df6d6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.576897:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931200/0xa6ea017771df6d6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577532:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931800/0xa6ea017771df6d73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577542:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931800/0xa6ea017771df6d73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577551:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931800/0xa6ea017771df6d73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351217.577650:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789351217.577656:0:10562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789351217.577759:0:10562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931800/0xa6ea017771df6d73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577786:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5930a00/0xa6ea017771df6d65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577793:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5930a00/0xa6ea017771df6d65 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577800:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5930a00/0xa6ea017771df6d65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577806:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cd5930a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351217.577811:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5930a00/0xa6ea017771df6d65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577818:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5930a00/0xa6ea017771df6d65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577832:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:1.0:1789351217.577835:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351217.577841:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5930a00/0xa6ea017771df6d65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577847:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5930a00/0xa6ea017771df6d65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577858:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931200/0xa6ea017771df6d6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577873:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931200/0xa6ea017771df6d6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577879:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931200/0xa6ea017771df6d6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577884:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cd5931200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351217.577888:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931200/0xa6ea017771df6d6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577894:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931200/0xa6ea017771df6d6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577902:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d2cc3d1cb00) 00010000:00010000:1.0:1789351217.577904:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351217.577907:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931200/0xa6ea017771df6d6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577912:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931200/0xa6ea017771df6d6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577959:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1600/0xa6ea017771df6d5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c4f expref: 8 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577974:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931800/0xa6ea017771df6d73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c4f expref: 7 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.577981:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:1.0:1789351217.577984:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789351217.577992:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cd5931800, rc 0) 00000100:00100000:1.0:1789351217.578094:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+7:9669:x1876270616951808:12345-192.168.201.52@tcp:101:touch.500 Request processed in 14027us (14809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351217.578105:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:1.0:1789351217.585722:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351217.585792:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616952064 00000100:00100000:3.0:1789351217.585806:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616952064 00000100:00100000:3.0:1789351217.585954:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:3.0:1789351217.585967:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+7:9669:x1876270616952064:12345-192.168.201.52@tcp:101:touch.500 00010000:00010000:3.0:1789351217.585999:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351217.586023:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4a00/0xa6ea017771df6d7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c56 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.586495:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4000/0xa6ea017771df6d81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.586514:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4000/0xa6ea017771df6d81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.586527:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4000/0xa6ea017771df6d81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.587950:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df6d88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.587977:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df6d88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.587989:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df6d88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789351217.593447:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1789351217.593817:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6d8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.593841:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.593856:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.593905:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4000/0xa6ea017771df6d81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.593913:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4000/0xa6ea017771df6d81 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.593920:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4000/0xa6ea017771df6d81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.593928:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c4000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351217.593933:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4000/0xa6ea017771df6d81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.593942:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4000/0xa6ea017771df6d81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.593956:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:0.0:1789351217.593960:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351217.593966:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4000/0xa6ea017771df6d81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.593972:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4000/0xa6ea017771df6d81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789351217.594002:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f23ce13 reply state 00000000ee8caaab transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df6d88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351217.594014:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789351217.594060:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4a00/0xa6ea017771df6d7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c56 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.594075:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6d8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c56 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.594083:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d2cc886e600) 00010000:00010000:0.0:1789351217.594085:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789351217.594088:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9000, rc 0) 00000100:00100000:0.0:1789351217.594183:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+10:9669:x1876270616952064:12345-192.168.201.52@tcp:101:touch.500 Request processed in 8217us (8473us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789351217.594194:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00010000:00010000:3.0:1789351217.597416:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df6d88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.597438:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df6d88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.597446:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df6d88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.597452:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c4200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351217.597457:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df6d88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.597466:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df6d88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.597484:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff8d2ce058f200) 00010000:00010000:3.0:1789351217.597487:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351217.597492:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df6d88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.597499:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df6d88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351217.601155:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351217.601443:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616952320 00000100:00100000:0.0:1789351217.601460:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616952320 00000100:00100000:0.0:1789351217.601576:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:0.0:1789351217.601589:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+9:9669:x1876270616952320:12345-192.168.201.52@tcp:36:touch.500 00010000:00010000:0.0:1789351217.601681:0:9467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351217.601715:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6d8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c56 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.601740:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d2cc886e600) 00010000:00010000:0.0:1789351217.601754:0:9467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789351217.601839:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6d9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.601857:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6d9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.601869:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6d9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789351217.602160:0:9467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004cf08df1 reply state 000000002d94b59d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6d9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351217.602172:0:9467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789351217.602304:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+10:9669:x1876270616952320:12345-192.168.201.52@tcp:36:touch.500 Request processed in 716us (1165us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789351217.602313:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00010000:00010000:1.0:1789351217.604087:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6d9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.604108:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6d9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.604118:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6d9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.604125:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351217.604132:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6d9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.604141:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6d9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.604160:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d2cc886e100) 00010000:00010000:1.0:1789351217.604164:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351217.604169:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6d9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.604176:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6d9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351217.604348:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351217.604482:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616952448 00000100:00100000:1.0:1789351217.604495:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616952448 00000100:00100000:1.0:1789351217.604853:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:1.0:1789351217.604866:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+9:9669:x1876270616952448:12345-192.168.201.52@tcp:101:touch.500 00010000:00010000:1.0:1789351217.604909:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351217.604931:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df6da4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c5d expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.605002:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df6da4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c5d expref: 10 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.605081:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df6da4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c5d expref: 10 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.605103:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d2cc3d1cb00) 00010000:00010000:1.0:1789351217.605106:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789351217.605109:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4800, rc 0) 00000100:00100000:1.0:1789351217.605187:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+10:9669:x1876270616952448:12345-192.168.201.52@tcp:101:touch.500 Request processed in 324us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351217.605195:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:2.0:1789351217.607622:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351217.607746:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616952576 00000100:00100000:1.0:1789351217.607759:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616952576 00000100:00100000:1.0:1789351217.607863:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:1.0:1789351217.607873:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1876270616952576:12345-192.168.201.52@tcp:8:touch.500 00010000:00080000:1.0:1789351217.607916:0:6660:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:1.0:1789351217.607953:0:6660:0:(genops.c:1406:class_connect()) connect: client 8237986d-b9e8-417a-ac8f-a078390d268c, cookie 0xa6ea017771df6dab 00002000:00100000:1.0:1789351217.607970:0:6660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8237986d-b9e8-417a-ac8f-a078390d268c/ffff8d2d00bfa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789351217.608000:0:6660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789351217.608344:0:6660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789351217.608419:0:6660:0:(import.c:65:import_set_state_nolock()) ffff8d2d00bf8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789351217.608506:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+6:2346:x1876270616952576:12345-192.168.201.52@tcp:8:touch.500 Request processed in 632us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351217.608515:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:2.0:1789351217.615437:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351217.615555:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616952704 00000100:00100000:1.0:1789351217.615569:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616952704 00000100:00100000:1.0:1789351217.615663:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:1.0:1789351217.615683:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:0:x1876270616952704:12345-192.168.201.52@tcp:2:touch.500 00000100:00080000:0.0:1789351217.616251:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789351217.654658:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1789351217.654683:0:7616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8237986d-b9e8-417a-ac8f-a078390d268c 00000100:00100000:1.0:1789351217.655432:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+5:0:x1876270616952704:12345-192.168.201.52@tcp:2:touch.500 Request processed in 39741us (40000us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789351217.655447:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:2.0:1789351217.658751:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351217.659083:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616952960 00000100:00100000:3.0:1789351217.659098:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616952960 00000100:00100000:3.0:1789351217.659221:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:3.0:1789351217.659235:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+10:9669:x1876270616952960:12345-192.168.201.52@tcp:35:touch.500 00000100:00100000:3.0:1789351217.659755:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+11:9669:x1876270616952960:12345-192.168.201.52@tcp:35:touch.500 Request processed in 521us (1017us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789351217.659764:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:2.0:1789351217.670008:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351217.670240:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616953088 00000100:00100000:0.0:1789351217.670254:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616953088 00000100:00100000:0.0:1789351217.670422:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:0.0:1789351217.670438:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+11:9670:x1876270616953088:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:0.0:1789351217.670474:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351217.670504:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6db2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c64 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.670598:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df6db9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.670616:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df6db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.670652:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df6db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351217.670736:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789351217.670741:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789351217.670805:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df6db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.670842:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6db2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c64 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.670866:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df6db9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c64 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.670876:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:0.0:1789351217.670880:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789351217.670885:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9a00, rc 0) 00000100:00100000:0.0:1789351217.670960:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+12:9670:x1876270616953088:12345-192.168.201.52@tcp:101:rm.0 Request processed in 526us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351217.670968:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:1.0:1789351217.679178:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351217.679337:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616953344 00000100:00100000:0.0:1789351217.679351:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616953344 00000100:00100000:0.0:1789351217.679571:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:0.0:1789351217.679585:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+12:9670:x1876270616953344:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:0.0:1789351217.679614:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351217.679640:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6dc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c6b expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351217.679918:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1789351217.680150:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6dc0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c6b expref: 14 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.680167:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:0.0:1789351217.680171:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789351217.680176:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6dc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c6b expref: 14 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.680194:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9000, rc 0) 00000100:00100000:0.0:1789351217.680282:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+13:9670:x1876270616953344:12345-192.168.201.52@tcp:101:rm.0 Request processed in 700us (1117us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1789351217.680290:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:2.0:1789351217.683724:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351217.683886:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616953472 00000100:00100000:1.0:1789351217.683900:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616953472 00000100:00100000:1.0:1789351217.683978:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:1.0:1789351217.683992:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+13:9670:x1876270616953472:12345-192.168.201.52@tcp:37:rm.0 00000100:00100000:2.0:1789351217.692698:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+13:9670:x1876270616953472:12345-192.168.201.52@tcp:37:rm.0 Request processed in 8694us (8974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351217.692715:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:2.0:1789351217.695515:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351217.700196:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616953728 00000100:00100000:3.0:1789351217.700218:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616953728 00000100:00100000:3.0:1789351217.700315:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:3.0:1789351217.700327:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf03a3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+13:9670:x1876270616953728:12345-192.168.201.52@tcp:35:rm.0 00000100:00100000:3.0:1789351217.700698:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf03a3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+14:9670:x1876270616953728:12345-192.168.201.52@tcp:35:rm.0 Request processed in 373us (5196us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789351217.700706:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:1.0:1789351217.708251:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351217.709878:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616953984 00000100:00100000:0.0:1789351217.709896:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616953984 00000100:00100000:0.0:1789351217.709968:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:0.0:1789351217.709979:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+14:9670:x1876270616953984:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:0.0:1789351217.710011:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351217.710035:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df6dce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c72 expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.710177:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df6dd5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.710190:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df6dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.710219:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df6dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351217.710230:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1789351217.710394:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df6dce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c72 expref: 17 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.710411:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df6dd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c72 expref: 16 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.710418:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:0.0:1789351217.710421:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789351217.710425:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8400, rc 0) 00000100:00100000:0.0:1789351217.710511:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+16:9670:x1876270616953984:12345-192.168.201.52@tcp:101:rm.0 Request processed in 532us (2273us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789351217.710518:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:0.0:1789351217.715636:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351217.715840:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616954112 00000100:00100000:1.0:1789351217.715853:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616954112 00000100:00100000:1.0:1789351217.715931:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:1.0:1789351217.715944:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+16:9670:x1876270616954112:12345-192.168.201.52@tcp:41:rm.0 00000004:00000024:1.0:1789351217.716034:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789351217.716121:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+16:9670:x1876270616954112:12345-192.168.201.52@tcp:41:rm.0 Request processed in 179us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351217.716127:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:2.0:1789351217.724241:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351217.724500:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616954240 00000100:00100000:0.0:1789351217.724515:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616954240 00000100:00100000:0.0:1789351217.724595:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:0.0:1789351217.724607:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+16:9670:x1876270616954240:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:0.0:1789351217.724637:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351217.724666:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df6de3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c79 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.724753:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df6dea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.724802:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df6dea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.724816:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df6dea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.724832:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df6df1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.724839:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df6df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.724845:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df6df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.724983:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6df8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.724990:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6df8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.724997:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6df8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351217.725028:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789351217.725033:0:9467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789351217.725054:0:9467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6df8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725068:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6df8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725088:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df6dea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725095:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df6dea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725102:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df6dea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725121:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351217.725126:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df6dea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725242:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df6dea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725258:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:0.0:1789351217.725261:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351217.725267:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df6dea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725274:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df6dea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725291:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df6df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725296:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df6df1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725302:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df6df1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725314:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351217.725317:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df6df1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725323:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df6df1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725331:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff8d2cc886e700) 00010000:00010000:0.0:1789351217.725333:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351217.725336:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df6df1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725341:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df6df1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725483:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df6de3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c79 expref: 18 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725499:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6df8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c79 expref: 17 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.725507:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d2cc3d1cb00) 00010000:00010000:0.0:1789351217.725510:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789351217.725513:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9000, rc 0) 00000100:00100000:0.0:1789351217.725597:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+17:9670:x1876270616954240:12345-192.168.201.52@tcp:101:rm.0 Request processed in 992us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351217.725605:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:3.0:1789351217.730586:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351217.730755:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616954496 00000100:00100000:0.0:1789351217.730793:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616954496 00000100:00100000:0.0:1789351217.730869:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:0.0:1789351217.730883:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+17:9670:x1876270616954496:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:0.0:1789351217.730962:0:10562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789351217.730999:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df6df8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c79 expref: 17 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.731027:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df6da4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c5d expref: 16 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.731040:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d2cc3d1cb00) 00010000:00010000:0.0:1789351217.731058:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df6db9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c64 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.731067:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:0.0:1789351217.731070:0:10562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789351217.731096:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6dff lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.731123:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6dff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.731140:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6dff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.731156:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6e06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.731163:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6e06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.731180:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6e06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.731326:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df6e0d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.731335:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df6e0d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.731341:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df6e0d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789351217.732208:0:10562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789351217.732225:0:10562:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 162177866208ns, next at 163177863128ns, rc = 0 00010000:00010000:0.0:1789351217.732293:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df6e14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732305:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df6e14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732316:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df6e14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732324:0:10562:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df6e14 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732332:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df6e14 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732338:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df6e14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732425:0:10562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789351217.732455:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df6e0d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732462:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df6e0d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732469:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df6e0d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732476:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351217.732481:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df6e0d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732489:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df6e0d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732501:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d2cc886e100) 00010000:00010000:0.0:1789351217.732504:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789351217.732508:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df6e0d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732515:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df6e0d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732536:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6dff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732543:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6dff lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732558:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6dff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732564:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351217.732566:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6dff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732573:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6dff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732581:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:0.0:1789351217.732584:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351217.732587:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6dff lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.732593:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df6dff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789351217.732604:0:10562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6091b4c reply state 00000000688ef4bf transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6e06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351217.732615:0:10562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789351217.732725:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+16:9670:x1876270616954496:12345-192.168.201.52@tcp:36:rm.0 Request processed in 1840us (2150us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789351217.732734:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00010000:00010000:3.0:1789351217.733163:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351217.733170:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df6e14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.733178:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8e00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351217.733182:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df6e14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.733189:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df6e14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.733207:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d2cc886e100) 00010000:00010000:3.0:1789351217.733209:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789351217.733213:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df6e14 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.733219:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df6e14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.733236:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351217.733238:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351217.733240:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351217.734630:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6e06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.734647:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6e06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.734672:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6e06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.734678:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351217.734683:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6e06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.734691:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6e06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.734706:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff8d2cc886e600) 00010000:00010000:0.0:1789351217.734709:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351217.734712:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6e06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351217.734718:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df6e06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351217.737394:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351217.738077:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616954752 00000100:00100000:2.0:1789351217.738091:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616954752 00000100:00100000:2.0:1789351217.738203:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:2.0:1789351217.738215:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+15:9670:x1876270616954752:12345-192.168.201.52@tcp:35:rm.0 00000100:00100000:2.0:1789351217.738622:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+16:9670:x1876270616954752:12345-192.168.201.52@tcp:35:rm.0 Request processed in 408us (1276us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789351217.738630:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:2.0:1789351217.745444:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351217.745695:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616955008 00000100:00100000:3.0:1789351217.745708:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616955008 00000100:00100000:3.0:1789351217.745792:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:3.0:1789351217.745806:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+16:9670:x1876270616955008:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:3.0:1789351217.746201:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789351217.746238:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df6dd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c72 expref: 16 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.746267:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cd5931800/0xa6ea017771df6d73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c4f expref: 15 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.746282:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:3.0:1789351217.746298:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79000/0xa6ea017771df6d34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c41 expref: 14 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351217.746305:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:3.0:1789351217.746531:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351217.746627:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6e1b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.746638:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6e1b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.746647:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6e1b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.746663:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df6e22 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.746668:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df6e22 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.746672:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df6e22 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.748156:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df6e29 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.748175:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df6e29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.748186:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df6e29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351217.749058:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1789351217.749081:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df6e29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.749091:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df6e29 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.749099:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df6e29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.749106:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351217.749112:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df6e29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.749134:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df6e29 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.749151:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d2ce9e1ac00) 00010000:00010000:2.0:1789351217.749154:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789351217.749160:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df6e29 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.749166:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df6e29 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.749194:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6e1b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.749200:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6e1b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.749207:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6e1b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.749212:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351217.749216:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6e1b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.749222:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6e1b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.749230:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a200) 00010000:00010000:2.0:1789351217.749232:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351217.749236:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6e1b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351217.749252:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6e1b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789351217.749267:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000607772e reply state 000000008d2abe05 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df6e22 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351217.749278:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789351217.749441:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+15:9670:x1876270616955008:12345-192.168.201.52@tcp:36:rm.0 Request processed in 3631us (4002us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789351217.749451:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00010000:00010000:1.0:1789351217.752847:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df6e22 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.752871:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df6e22 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.752880:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df6e22 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.752886:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351217.752891:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df6e22 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.752898:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df6e22 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.752918:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d2ce9e1a900) 00010000:00010000:1.0:1789351217.752921:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351217.752926:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df6e22 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351217.752933:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df6e22 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351218.145618:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351218.849719:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626414848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789351218.849829:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351218.849972:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626414848 00000100:00100000:1.0:1789351218.849981:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626414848 00000100:00100000:1.0:1789351218.850066:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789351218.850078:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626414848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789351218.850143:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789351218.850193:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626414848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351218.850201:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789351218.850314:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789351218.850352:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf9d8df80 x1876270626414848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351218.850405:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626414848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789351219.170339:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351220.194481:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789351220.227697:0:11578:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000020:00000080:1.0:1789351220.849586:0:11626:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6fc54910 20000000:00000080:1.0:1789351220.849602:0:11626:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2cd8480000 uarg=0000000000000000 20000000:01000000:1.0:1789351220.849704:0:11626:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789351220.849710:0:11626:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789351220.849715:0:11626:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789351220.850579:0:11627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789351220.850798:0:11626:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789351220.855299:0:11626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1789351220.855496:0:11626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1789351220.855558:0:11626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1789351220.855575:0:11626:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789351220.855594:0:11626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2ceecc5800/0xa6ea017771df6e30 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.855625:0:11626:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ceecd8000/0xa6ea017771df6cd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c2c expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.855634:0:11626:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cf0f79800/0xa6ea017771df6cd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c33 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.855654:0:11626:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cd5930200/0xa6ea017771df6ce7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6ce0 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.855661:0:11626:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cd5931e00/0xa6ea017771df6cf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6cee expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.855667:0:11626:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6d03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6cfc expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.855674:0:11626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2ceecc5800/0xa6ea017771df6e30 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.855709:0:11626:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6cfc expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.855732:0:11626:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6d03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6cfc expref: 18 pid: 5816 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351220.855747:0:11626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11626:1876270626414976:0@lo:104: 00000100:00100000:1.0:1789351220.855808:0:11626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789351220.855866:0:11626:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cd5931e00/0xa6ea017771df6cf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6cee expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.855874:0:11626:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2cd5931e00/0xa6ea017771df6cf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6cee expref: 18 pid: 5816 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351220.855882:0:11626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff973800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11626:1876270626415104:0@lo:104: 00000100:00100000:1.0:1789351220.855901:0:11626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789351220.855930:0:11626:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cd5930200/0xa6ea017771df6ce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df6ce0 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.855944:0:11626:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d2cd5930200/0xa6ea017771df6ce7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df6ce0 expref: 18 pid: 5814 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351220.855953:0:11626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff970380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11626:1876270626415232:0@lo:104: 00000100:00100000:1.0:1789351220.855983:0:11626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351220.856012:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626414976 00000100:00100000:1.0:1789351220.856018:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626414976 00000100:00100000:1.0:1789351220.856052:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626415104 00000100:00100000:1.0:1789351220.856055:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626415104 00000100:00100000:1.0:1789351220.856065:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626415232 00000100:00100000:1.0:1789351220.856067:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626415232 00000100:00100000:1.0:1789351220.856081:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789351220.856090:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff973b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+5:11626:x1876270626414976:12345-0@lo:104: 00010000:00010000:1.0:1789351220.856102:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8200/0xa6ea017771df6cfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6d03 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856145:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789351220.856151:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff973b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+5:11626:x1876270626414976:12345-0@lo:104: Request processed in 62us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351220.856157:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789351220.856171:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789351220.856177:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff973100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+4:11626:x1876270626415104:12345-0@lo:104: 00010000:00010000:1.0:1789351220.856183:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78000/0xa6ea017771df6cee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6cf5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856209:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789351220.856214:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff973100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+4:11626:x1876270626415104:12345-0@lo:104: Request processed in 38us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351220.856225:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789351220.856235:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789351220.856240:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff970000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+3:11626:x1876270626415232:12345-0@lo:104: 00010000:00010000:1.0:1789351220.856248:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6ce0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6ce7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856275:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789351220.856280:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff970000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+3:11626:x1876270626415232:12345-0@lo:104: Request processed in 40us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351220.856285:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789351220.856299:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789351220.856305:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8200/0xa6ea017771df6cfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6d03 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856311:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8200 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:1.0:1789351220.856315:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8200/0xa6ea017771df6cfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6d03 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856323:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8200/0xa6ea017771df6cfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6d03 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789351220.856329:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8200/0xa6ea017771df6cfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6d03 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351220.856335:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789351220.856381:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8200/0xa6ea017771df6cfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6d03 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856388:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789351220.856412:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8200/0xa6ea017771df6cfc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6d03 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856418:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8200/0xa6ea017771df6cfc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6d03 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856430:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789351220.856433:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78000/0xa6ea017771df6cee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6cf5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856438:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f78000 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:1.0:1789351220.856441:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78000/0xa6ea017771df6cee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6cf5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856447:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78000/0xa6ea017771df6cee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6cf5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789351220.856453:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78000/0xa6ea017771df6cee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6cf5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351220.856457:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789351220.856469:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78000/0xa6ea017771df6cee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6cf5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856475:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789351220.856480:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78000/0xa6ea017771df6cee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6cf5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856485:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78000/0xa6ea017771df6cee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6cf5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856493:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789351220.856500:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6ce0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df6ce7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856506:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c5e00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:1.0:1789351220.856508:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6ce0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df6ce7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856514:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6ce0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df6ce7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789351220.856520:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6ce0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df6ce7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351220.856525:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789351220.856535:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6ce0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6ce7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856540:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789351220.856553:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6ce0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6ce7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856559:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6ce0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df6ce7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856570:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351220.856572:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351220.856574:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351220.856584:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626415488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789351220.856607:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351220.856628:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789351220.856633:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626415360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789351220.856655:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351220.856673:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789351220.856680:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626415616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789351220.856697:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351220.856716:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626415488 00000100:00100000:1.0:1789351220.856733:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626415488 00010000:00010000:1.0:1789351220.856749:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cd5931e00/0xa6ea017771df6cf5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6cee expref: 19 pid: 5816 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351220.856767:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626415360 00000100:00100000:1.0:1789351220.856769:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626415360 00010000:00010000:1.0:1789351220.856778:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6d03 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6cfc expref: 20 pid: 5816 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351220.856786:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626415616 00000100:00100000:1.0:1789351220.856789:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626415616 00010000:00010000:1.0:1789351220.856797:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cd5930200/0xa6ea017771df6ce7 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6ce0 expref: 21 pid: 5814 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351220.856806:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789351220.856812:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff970a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7166352-9951-4386-a0b0-6dc1f552d00a+21:3289:x1876270626415488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351220.856820:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351220.856824:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cd5931e00/0xa6ea017771df6cf5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6cee expref: 21 pid: 5816 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856833:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cd5931e00/0xa6ea017771df6cf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6cee expref: 21 pid: 5816 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856846:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351220.856869:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff970a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7166352-9951-4386-a0b0-6dc1f552d00a+21:3289:x1876270626415488:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351220.856880:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789351220.856894:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789351220.856900:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff970700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7166352-9951-4386-a0b0-6dc1f552d00a+20:3289:x1876270626415360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351220.856906:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351220.856911:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6d03 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6cfc expref: 20 pid: 5816 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856919:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6d03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6cfc expref: 20 pid: 5816 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856928:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351220.856949:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff970700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7166352-9951-4386-a0b0-6dc1f552d00a+20:3289:x1876270626415360:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351220.856956:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789351220.856967:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789351220.856973:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff972a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3287:x1876270626415616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351220.856980:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351220.856984:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cd5930200/0xa6ea017771df6ce7 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df6ce0 expref: 19 pid: 5814 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.856993:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cd5930200/0xa6ea017771df6ce7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df6ce0 expref: 19 pid: 5814 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.857001:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351220.857023:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff972a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3287:x1876270626415616:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351220.857029:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789351220.857061:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626415616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789351220.857091:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626415360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789351220.857099:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626415488:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351220.857126:0:11626:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cf0f79800/0xa6ea017771df6cd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c33 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.857149:0:11626:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2cf0f79800/0xa6ea017771df6cd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c33 expref: 12 pid: 5814 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351220.857159:0:11626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11626:1876270626415744:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351220.857302:0:11626:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ceecd8000/0xa6ea017771df6cd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c2c expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.857311:0:11626:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2ceecd8000/0xa6ea017771df6cd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c2c expref: 12 pid: 5817 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351220.857319:0:11626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff972d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11626:1876270626415872:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789351220.857344:0:11626:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ceeca1240 going to sleep for 11 seconds 00010000:00010000:1.0:1789351220.857370:0:11626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cd5931c00/0xa6ea017771df6d03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6cfc expref: 18 pid: 5816 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351220.857381:0:11626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11626:1876270626414976:0@lo:104: 00010000:00010000:1.0:1789351220.857391:0:11626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cd5931e00/0xa6ea017771df6cf5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6cee expref: 17 pid: 5816 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351220.857398:0:11626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff973800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11626:1876270626415104:0@lo:104: 00010000:00010000:1.0:1789351220.857404:0:11626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cd5930200/0xa6ea017771df6ce7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df6ce0 expref: 16 pid: 5814 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351220.857421:0:11626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff970380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11626:1876270626415232:0@lo:104: 00010000:00010000:3.0:1789351220.857689:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351220.857752:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351220.865914:0:11626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11626:1876270626415744:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789351220.865931:0:11626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff972d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11626:1876270626415872:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351220.865968:0:11626:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2ceecc5800/0xa6ea017771df6e30 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351220.867906:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351220.867963:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351220.868030:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616955136 00000100:00100000:2.0:1789351220.868040:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616955136 00010000:00010000:2.0:1789351220.868080:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cf0f79800/0xa6ea017771df6cd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c33 expref: 13 pid: 5814 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351220.868119:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616955264 00000100:00100000:2.0:1789351220.868123:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616955264 00010000:00010000:2.0:1789351220.868134:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ceecd8000/0xa6ea017771df6cd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c2c expref: 14 pid: 5817 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351220.868163:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:2.0:1789351220.868173:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc312f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:038b9b38-b2ec-45ac-958b-dad437feb5c7+14:2347:x1876270616955136:12345-192.168.201.52@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789351220.868187:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00010000:00010000:2.0:1789351220.868188:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351220.868197:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cf0f79800/0xa6ea017771df6cd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c33 expref: 14 pid: 5814 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351220.868206:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff972d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:038b9b38-b2ec-45ac-958b-dad437feb5c7+14:2348:x1876270616955264:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789351220.868213:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cf0f79800/0xa6ea017771df6cd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c33 expref: 14 pid: 5814 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351220.868218:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351220.868227:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ceecd8000/0xa6ea017771df6cd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c2c expref: 14 pid: 5817 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351220.868250:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cf0f79800/0xa6ea017771df6cd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c33 expref: 14 pid: 5814 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351220.868254:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ceecd8000/0xa6ea017771df6cd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c2c expref: 14 pid: 5817 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351220.868275:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ceecd8000/0xa6ea017771df6cd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c2c expref: 13 pid: 5817 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351220.868277:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2ceecc5800/0xa6ea017771df6e30 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351220.868292:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecc5800/0xa6ea017771df6e30 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351220.869927:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351220.869947:0:6676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2ceecc5800/0xa6ea017771df6e30 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351220.869960:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2ceecc5800/0xa6ea017771df6e30 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351220.869967:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2ceecc5800/0xa6ea017771df6e30 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351220.869974:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2ceecc5800/0xa6ea017771df6e30 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351220.869980:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5800 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351220.869985:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2ceecc5800/0xa6ea017771df6e30 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351220.869992:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2ceecc5800/0xa6ea017771df6e30 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351220.870015:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2ceecc5800/0xa6ea017771df6e30 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351220.870043:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789351220.870064:0:11626:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2ceecc5800/0xa6ea017771df6e30 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.870075:0:11626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2ceecc5800/0xa6ea017771df6e30 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351220.870082:0:11626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ceecc5800/0xa6ea017771df6e30 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351220.870103:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc312f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:2347:x1876270616955136:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 1927us (2202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351220.870113:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:3.0:1789351220.871545:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff972d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:2348:x1876270616955264:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 3340us (3582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351220.871557:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:0.0:1789351220.898543:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626416000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789351220.898608:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789351220.898689:0:8179:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 165344329948ns, next at 166344328345ns, rc = 0 00000100:00100000:0.0:1789351220.898994:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789351220.899003:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626416384:0@lo:400:kworker.0 00000100:00100000:0.0:1789351220.899035:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351220.899065:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876270626416512:0@lo:400:kworker.0 00000100:00100000:3.0:1789351220.899079:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876270626416128:0@lo:400:kworker.0 00000100:00100000:0.0:1789351220.899090:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351220.899119:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626416000 00000100:00100000:0.0:1789351220.899130:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626416000 00000100:00100000:3.0:1789351220.899135:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351220.899166:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789351220.899173:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626416256:0@lo:400:kworker.0 00000100:00100000:0.0:1789351220.899189:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789351220.899204:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626416000:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789351220.899205:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789351220.899238:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789351220.899253:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626416512 00000100:00100000:3.0:1789351220.899259:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626416512 00000100:00100000:0.0:1789351220.899289:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626416000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351220.899296:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789351220.899298:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626416128 00000100:00100000:3.0:1789351220.899308:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626416128 00000100:00100000:0.0:1789351220.899322:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626416384 00000100:00100000:0.0:1789351220.899326:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626416384 00000100:00100000:3.0:1789351220.899338:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626416256 00000100:00100000:3.0:1789351220.899343:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626416256 00000100:00100000:0.0:1789351220.899385:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789351220.899392:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626416384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351220.899399:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789351220.899411:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876270626416512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351220.899421:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626416384:12345-0@lo:400:kworker.0 Request processed in 30us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351220.899427:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789351220.899446:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789351220.899452:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876270626416128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351220.899464:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876270626416512:12345-0@lo:400:kworker.0 Request processed in 55us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351220.899482:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876270626416128:12345-0@lo:400:kworker.0 Request processed in 30us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351220.899699:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876270626416512:0@lo:400:kworker.0 00010000:00080000:1.0:1789351220.899711:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc6f67b80 x1876270626416384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351220.899730:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626416384:0@lo:400:kworker.0 00010000:00080000:1.0:1789351220.899744:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cff971c00 x1876270626416000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351220.899759:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626416000:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789351220.899812:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789351220.899818:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789351220.899820:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789351220.900036:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789351220.900102:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789351220.900108:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789351220.900119:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626416256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351220.900160:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626416256:12345-0@lo:400:kworker.0 Request processed in 45us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351220.900162:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876270626416128:0@lo:400:kworker.0 00000100:00100000:1.0:1789351220.900167:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789351220.900178:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626416256:0@lo:400:kworker.0 00000100:00100000:1.0:1789351221.164196:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351221.164243:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351221.164278:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351221.164389:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616955520 00000100:00100000:2.0:1789351221.164399:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616955520 00000100:00100000:2.0:1789351221.164470:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00080000:1.0:1789351221.164575:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789351221.164615:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+5:2347:x1876270616955520:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351221.164723:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+5:2347:x1876270616955520:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 232us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351221.164732:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:0.0:1789351221.165100:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616955392 00000100:00100000:0.0:1789351221.165105:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616955392 00000100:00100000:0.0:1789351221.165150:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616955648 00000100:00100000:0.0:1789351221.165153:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616955648 00000100:00100000:0.0:1789351221.165178:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:0.0:1789351221.165186:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+14:2347:x1876270616955392:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351221.165245:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+14:2347:x1876270616955392:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 60us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351221.165252:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:0.0:1789351221.165267:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:0.0:1789351221.165274:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2347:x1876270616955648:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351221.165299:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2347:x1876270616955648:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 26us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351221.165305:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00080000:1.0:1789351221.165446:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789351221.174434:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351221.174930:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616955776 00000100:00100000:0.0:1789351221.174941:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616955776 00000100:00100000:0.0:1789351221.175075:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:0.0:1789351221.175086:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2346:x1876270616955776:12345-192.168.201.52@tcp:9:kworker.0 00000020:00000080:0.0:1789351221.175116:0:6663:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6cbd 00000100:00080000:0.0:1789351221.175125:0:6663:0:(import.c:65:import_set_state_nolock()) ffff8d2cffaea800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789351221.175176:0:6663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789351221.178415:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+2:2346:x1876270616955776:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 3321us (3978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351221.178430:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00010000:00010000:3.0:1789351221.179105:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351221.179314:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351221.179388:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616955904 00000100:00100000:2.0:1789351221.179396:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616955904 00000100:00080000:1.0:1789351221.180335:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789351221.180344:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789351221.182881:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:2.0:1789351221.182912:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2346:x1876270616955904:12345-192.168.201.52@tcp:9:kworker.0 00000020:00000080:2.0:1789351221.182945:0:6661:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6cc4 00000100:00080000:2.0:1789351221.182964:0:6661:0:(import.c:65:import_set_state_nolock()) ffff8d2cffaea000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789351221.183009:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789351221.183388:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+2:2346:x1876270616955904:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 481us (4074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351221.183396:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00010000:00010000:3.0:1789351221.184039:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351221.217621:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789351221.986829:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789351221.986837:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2cc5aa8000 from 7 10000000:01000000:0.0:1789351221.986843:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789351221.986892:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351221.986903:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351221.986929:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351221.986953:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626416640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789351221.987074:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351221.987172:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789351221.987233:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626416640 00000100:00100000:3.0:1789351221.987241:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626416640 00000100:00100000:3.0:1789351221.987377:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789351221.987399:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+16:5820:x1876270626416640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789351221.987414:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351221.987427:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d021c4200/0xa6ea017771df6e3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6e37 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351221.987449:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d021c4200/0xa6ea017771df6e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6e37 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351221.987459:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d021c4200/0xa6ea017771df6e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6e37 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351221.987468:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c4200, rc 0) 00000100:00100000:3.0:1789351221.987559:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626416640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351221.987566:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789351221.987779:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626416640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789351221.987794:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6e3e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351221.987803:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6e3e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351221.987853:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626416768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351221.987878:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351221.987905:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789351221.987952:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626416768 00000100:00100000:1.0:1789351221.987956:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626416768 00000100:00100000:1.0:1789351221.987986:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789351221.987993:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626416768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351221.988244:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626416768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351221.988251:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789351221.988369:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626416768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351221.988407:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626416896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789351221.988443:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351221.988462:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789351221.988608:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626416896 00000100:00100000:1.0:1789351221.988613:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626416896 00000100:00100000:1.0:1789351221.988671:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789351221.988678:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626416896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351221.988828:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626416896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351221.988835:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789351221.988944:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626416896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789351221.989479:0:11639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:11639:1876270626417024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789351221.989514:0:11639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351221.989544:0:11639:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789351221.989601:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626417024 00000100:00100000:1.0:1789351221.989605:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626417024 00000100:00100000:1.0:1789351221.989633:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789351221.989640:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:11639:x1876270626417024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351221.989787:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:11639:x1876270626417024:12345-0@lo:502:llog_process_th.0 Request processed in 147us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351221.989794:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789351221.989897:0:11639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:11639:1876270626417024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789351221.989915:0:11639:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789351221.989922:0:11639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789351221.989924:0:11639:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789351221.989930:0:11639:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2cc5aa8000 00000020:00000080:0.0:1789351221.989931:0:11639:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789351221.990050:0:11639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:11639:1876270626417152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789351221.990082:0:11639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351221.990104:0:11639:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789351221.990480:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626417152 00000100:00100000:3.0:1789351221.990484:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626417152 00000100:00100000:3.0:1789351221.990509:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789351221.990514:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:11639:x1876270626417152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789351221.990609:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:11639:x1876270626417152:12345-0@lo:502:llog_process_th.0 Request processed in 95us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351221.990614:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789351221.990809:0:11639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:11639:1876270626417152:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789351221.990828:0:11639:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789351221.990832:0:11639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789351221.990834:0:11639:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789351221.990838:0:11639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789351221.996542:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789351221.996575:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789351221.996586:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6e3e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351221.996599:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6e3e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351221.996609:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789351221.996611:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2cf76fd000 from 7 10000000:01000000:3.0:1789351221.996614:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789351221.996651:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351221.996660:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351221.996670:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351221.996691:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626417280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789351221.996762:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351221.996888:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc31d6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789351221.996937:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626417280 00000100:00100000:2.0:1789351221.996945:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626417280 00000100:00100000:2.0:1789351221.996989:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789351221.996999:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:5820:x1876270626417280:12345-0@lo:101:ll_cfg_requeue.0 00000040:00080000:0.0:1789351222.003535:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789351222.003667:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351222.003690:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d00bc1400/0xa6ea017771df6e4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6e45 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351222.003731:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d00bc1400/0xa6ea017771df6e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6e45 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351222.003744:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d00bc1400/0xa6ea017771df6e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6e45 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351222.003754:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1400, rc 0) 00000100:00100000:2.0:1789351222.003843:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626417280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 6842us (7077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351222.003852:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789351222.004403:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626417280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789351222.004422:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6e4c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351222.004432:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6e4c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351222.004497:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626417408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789351222.004534:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351222.004567:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc31d6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789351222.005882:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626417408 00000100:00100000:2.0:1789351222.005893:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626417408 00000100:00100000:2.0:1789351222.005985:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789351222.005994:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626417408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789351222.006257:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626417408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351222.006265:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789351222.006332:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626417408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351222.006389:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626417536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351222.006426:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351222.011466:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ceeca1480 going to sleep for 11 seconds 00000100:00100000:3.0:1789351222.011642:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626417536 00000100:00100000:3.0:1789351222.011650:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626417536 00000100:00100000:0.0:1789351222.011721:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789351222.011734:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626417536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789351222.011974:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626417536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (5546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351222.011981:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789351222.012255:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626417536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351222.012795:0:11643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:11643:1876270626417664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351222.012844:0:11643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351222.012879:0:11643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ceeca1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789351222.012919:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626417664 00000100:00100000:0.0:1789351222.012925:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626417664 00000100:00100000:0.0:1789351222.012958:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789351222.012966:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+18:11643:x1876270626417664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789351222.013559:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+18:11643:x1876270626417664:12345-0@lo:502:llog_process_th.0 Request processed in 593us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351222.013576:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789351222.013648:0:11643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:11643:1876270626417664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789351222.013674:0:11643:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789351222.013685:0:11643:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351222.013687:0:11643:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789351222.013693:0:11643:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2cf76fd000 00000020:00000080:1.0:1789351222.013696:0:11643:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789351222.013791:0:11643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:11643:1876270626417792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351222.013829:0:11643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351222.013849:0:11643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ceeca1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789351222.013900:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626417792 00000100:00100000:2.0:1789351222.013905:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626417792 00000100:00100000:2.0:1789351222.013940:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789351222.013948:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:11643:x1876270626417792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789351222.014218:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:11643:x1876270626417792:12345-0@lo:502:llog_process_th.0 Request processed in 270us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351222.014320:0:11643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:11643:1876270626417792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789351222.014337:0:11643:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789351222.014341:0:11643:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351222.014343:0:11643:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789351222.014346:0:11643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:2.0:1789351222.014469:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000020:01000000:2.0:1789351222.014650:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789351222.014670:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789351222.014680:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6e4c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351222.014690:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6e4c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351222.014712:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789351222.014715:0:5820:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2cc5fed000 from 7 10000000:01000000:2.0:1789351222.014718:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789351222.014742:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351222.014751:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351222.014760:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351222.014772:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626417920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789351222.014797:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351222.014935:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0c0f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789351222.016792:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626417920 00000100:00100000:3.0:1789351222.016807:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626417920 00000100:00100000:3.0:1789351222.016851:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789351222.016862:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+18:5820:x1876270626417920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789351222.016879:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351222.016896:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df6e5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df6e53 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351222.016922:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df6e5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df6e53 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351222.016933:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df6e5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df6e53 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351222.016943:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c4a00, rc 0) 00000100:00100000:3.0:1789351222.017017:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:5820:x1876270626417920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (2218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351222.017030:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789351222.018573:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626417920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789351222.018597:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6e5a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351222.018609:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6e5a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351222.018683:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626418048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351222.020203:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351222.020536:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52900 going to sleep for 11 seconds 00000100:00100000:1.0:1789351222.021014:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626418048 00000100:00100000:1.0:1789351222.021024:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626418048 00000100:00100000:1.0:1789351222.021093:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789351222.021103:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:5820:x1876270626418048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351222.021398:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:5820:x1876270626418048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351222.021405:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789351222.021405:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626418048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351222.021448:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626418176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789351222.021488:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351222.021519:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52900 going to sleep for 11 seconds 00000100:00100000:1.0:1789351222.021561:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626418176 00000100:00100000:1.0:1789351222.021566:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626418176 00000100:00100000:1.0:1789351222.021594:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789351222.021602:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:5820:x1876270626418176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351222.021762:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:5820:x1876270626418176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351222.021768:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789351222.021800:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f7166352-9951-4386-a0b0-6dc1f552d00a:5820:1876270626418176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789351222.022240:0:11645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:11645:1876270626418304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789351222.022267:0:11645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351222.022283:0:11645:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789351222.022306:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626418304 00000100:00100000:3.0:1789351222.022311:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626418304 00000100:00100000:3.0:1789351222.022343:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789351222.022350:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:11645:x1876270626418304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789351222.022968:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:11645:x1876270626418304:12345-0@lo:502:llog_process_th.0 Request processed in 617us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351222.022976:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789351222.023110:0:11645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:11645:1876270626418304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789351222.023145:0:11645:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789351222.023153:0:11645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351222.023155:0:11645:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789351222.023163:0:11645:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2cc5fed000 00000020:00000080:2.0:1789351222.023169:0:11645:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789351222.023257:0:11645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:11645:1876270626418432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789351222.023291:0:11645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351222.023319:0:11645:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0c0fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789351222.023484:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626418432 00000100:00100000:2.0:1789351222.023489:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626418432 00000100:00100000:2.0:1789351222.023521:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789351222.023528:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:11645:x1876270626418432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789351222.023643:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:11645:x1876270626418432:12345-0@lo:502:llog_process_th.0 Request processed in 115us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351222.023649:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789351222.023684:0:11645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f7166352-9951-4386-a0b0-6dc1f552d00a:11645:1876270626418432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789351222.023715:0:11645:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789351222.023720:0:11645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351222.023721:0:11645:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789351222.023725:0:11645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789351222.023842:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789351222.023860:0:5820:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789351222.023869:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6e5a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351222.023886:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6e5a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351222.241568:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351222.507129:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351222.508283:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616956032 00000100:00100000:3.0:1789351222.508295:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616956032 00000100:00100000:3.0:1789351222.508374:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 239 00000100:00100000:3.0:1789351222.508386:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:5583:x1876270616956032:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789351222.508405:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351222.508423:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6e61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c80 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351222.508452:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c80 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351222.508465:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c80 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351222.508596:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c4000, rc 0) 00000100:00100000:3.0:1789351222.508707:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:5583:x1876270616956032:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 323us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351222.508716:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 239 00000100:00100000:1.0:1789351222.512571:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351222.512645:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616956160 00000100:00100000:2.0:1789351222.512655:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616956160 00000100:00100000:2.0:1789351222.512721:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 240 00000100:00100000:2.0:1789351222.512733:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:5583:x1876270616956160:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789351222.513036:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:5583:x1876270616956160:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 305us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351222.513045:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 240 00000100:00100000:0.0:1789351222.515323:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351222.515438:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616956288 00000100:00100000:3.0:1789351222.515447:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616956288 00000100:00100000:3.0:1789351222.515495:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 241 00000100:00100000:3.0:1789351222.515505:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:5583:x1876270616956288:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789351222.515723:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:5583:x1876270616956288:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 219us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351222.515742:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 241 00000100:00100000:0.0:1789351222.529525:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351222.529600:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616956416 00000100:00100000:2.0:1789351222.529611:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616956416 00000100:00100000:2.0:1789351222.529671:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 242 00000100:00100000:2.0:1789351222.529680:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:9941:x1876270616956416:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789351222.529959:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:9941:x1876270616956416:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 279us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351222.529968:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 242 00000100:00100000:1.0:1789351222.532193:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351222.532353:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616956544 00000100:00100000:0.0:1789351222.532480:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616956544 00000100:00100000:0.0:1789351222.532542:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 243 00000100:00100000:0.0:1789351222.532554:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:9941:x1876270616956544:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789351222.533184:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:9941:x1876270616956544:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 632us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351222.533192:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 243 00000100:00100000:0.0:1789351222.539817:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351222.543074:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616956672 00000100:00100000:3.0:1789351222.543091:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616956672 00000100:00100000:3.0:1789351222.543162:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 244 00000100:00100000:3.0:1789351222.543174:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:5583:x1876270616956672:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789351222.543191:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351222.543234:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cc3104000/0xa6ea017771df6e68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c87 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351222.543265:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cc3104000/0xa6ea017771df6e68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c87 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351222.543277:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cc3104000/0xa6ea017771df6e68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c87 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351222.543287:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104000, rc 0) 00000100:00100000:3.0:1789351222.543782:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:5583:x1876270616956672:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 609us (3973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351222.543792:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 244 00000100:00100000:1.0:1789351222.546721:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351222.546788:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616956800 00000100:00100000:0.0:1789351222.546799:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616956800 00000100:00100000:0.0:1789351222.546858:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 245 00000100:00100000:0.0:1789351222.546870:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:5583:x1876270616956800:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351222.547178:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:5583:x1876270616956800:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 309us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351222.547188:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 245 00000100:00100000:1.0:1789351222.550740:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351222.550911:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616956928 00000100:00100000:3.0:1789351222.550921:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616956928 00000100:00100000:3.0:1789351222.551054:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 246 00000100:00100000:3.0:1789351222.551064:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:5583:x1876270616956928:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789351222.551398:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:5583:x1876270616956928:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 333us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351222.551406:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 246 00000100:00100000:2.0:1789351222.556924:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351222.557457:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616957056 00000100:00100000:0.0:1789351222.557468:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616957056 00000100:00100000:0.0:1789351222.557686:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 247 00000100:00100000:0.0:1789351222.557709:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:9944:x1876270616957056:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789351222.558091:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:9944:x1876270616957056:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 383us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351222.558099:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 247 00000100:00100000:1.0:1789351222.561761:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351222.561921:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616957184 00000100:00100000:3.0:1789351222.561931:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616957184 00000100:00100000:3.0:1789351222.562101:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 248 00000100:00100000:3.0:1789351222.562112:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:9944:x1876270616957184:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789351222.562407:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:9944:x1876270616957184:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 296us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351222.562415:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 248 00000001:00100000:1.0:1789351222.984937:0:7616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8d53186e-ebf3-44d4-99b7-0a4ed0545c2b 00000020:00000080:1.0:1789351222.984949:0:7616:0:(genops.c:906:class_export_put()) final put ffff8d2cffaed800/8d53186e-ebf3-44d4-99b7-0a4ed0545c2b 00000020:00000080:1.0:1789351222.984979:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cffaed800/8d53186e-ebf3-44d4-99b7-0a4ed0545c2b for lustre-OST0001 00000020:00000080:1.0:1789351222.985021:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2cffaea000 for lustre-OST0001 00000001:00080000:1.0:1789351223.000328:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:1.0:1789351223.000340:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789351223.000742:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789351223.000765:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626418560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789351223.000837:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351223.001034:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626418560 00000100:00100000:0.0:1789351223.001042:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626418560 00000100:00100000:0.0:1789351223.001111:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789351223.001122:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cefce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626418560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789351223.001150:0:6663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1789351223.001187:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa75531, atime: 0x6aa75531, ctime: 0x6aa75531, blocks: 0x1 00010000:00010000:0.0:1789351223.001196:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed5c54d3/0xa6ea017771df6e6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351223.001225:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=167s v=(0 0) 00010000:00010000:0.0:1789351223.001229:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351223.001237:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed5c54d3/0xa6ea017771df6e6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351223.001254:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed5c54d3/0xa6ea017771df6e6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351223.001263:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed5c54d3/0xa6ea017771df6e6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351223.001271:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed5c54d3/0xa6ea017771df6e6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351223.001289:0:6663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789351223.002105:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cefce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3289:x1876270626418560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 982us (1264us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789351223.002113:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1789351223.002418:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2cf69f5c00/2, rc 0, transno 4294967300 00000100:00100000:2.0:1789351223.002426:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626418560:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1789351223.002549:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789351223.002695:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351223.002703:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed5c54d3/0xa6ea017771df6e6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351223.002714:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030e00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351223.002719:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed5c54d3/0xa6ea017771df6e6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351223.002728:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed5c54d3/0xa6ea017771df6e6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351223.002751:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed5c54d3/0xa6ea017771df6e6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351223.002760:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed5c54d3/0xa6ea017771df6e6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351223.002796:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351223.002799:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351223.002800:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789351223.002997:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1789351223.003029:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000040:00080000:0.0:1789351223.013140:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789351223.265911:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351223.970918:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626418688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789351223.970992:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351223.971310:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626418688 00000100:00100000:0.0:1789351223.971323:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626418688 00000100:00100000:0.0:1789351223.971438:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789351223.971448:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626418688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789351223.971481:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789351223.971537:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626418688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351223.971557:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789351223.971701:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf9d8e680 x1876270626418688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351223.971724:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626418688:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789351223.973426:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789351224.289926:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351225.313611:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789351225.528501:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8d53186e-ebf3-44d4-99b7-0a4ed0545c2b 00000020:00000080:1.0:1789351225.528511:0:6689:0:(genops.c:906:class_export_put()) final put ffff8d2cffaeb800/8d53186e-ebf3-44d4-99b7-0a4ed0545c2b 00000020:00000080:2.0:1789351225.528578:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cffaeb800/8d53186e-ebf3-44d4-99b7-0a4ed0545c2b for lustre-OST0000 00000020:00000080:2.0:1789351225.528625:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2cffaea800 for lustre-OST0000 00000100:00100000:2.0:1789351226.018133:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626418816:0@lo:400:kworker.0 00000100:00100000:2.0:1789351226.018210:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351226.018265:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876270626419328:0@lo:400:kworker.0 00000100:00100000:2.0:1789351226.018294:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351226.018324:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789351226.018330:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626418944:0@lo:400:kworker.0 00000100:00100000:2.0:1789351226.018350:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351226.018393:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626419456:0@lo:400:kworker.0 00000100:00100000:2.0:1789351226.018417:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351226.018445:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626419328 00000100:00100000:2.0:1789351226.018452:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626419328 00000100:00100000:2.0:1789351226.018490:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626418944 00000100:00100000:2.0:1789351226.018492:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626418944 00000100:00100000:2.0:1789351226.018506:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789351226.018512:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876270626419328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351226.018549:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876270626419328:12345-0@lo:400:kworker.0 Request processed in 37us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351226.018553:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789351226.018565:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789351226.018580:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626418944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351226.018598:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626418944:12345-0@lo:400:kworker.0 Request processed in 19us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351226.018602:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1789351226.018613:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789351226.018647:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626418944:0@lo:400:kworker.0 00000100:00100000:2.0:1789351226.018660:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876270626419328:0@lo:400:kworker.0 00000100:00100000:0.0:1789351226.018844:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626418816 00000100:00100000:0.0:1789351226.018849:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626418816 00000100:00100000:0.0:1789351226.018883:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789351226.018891:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3286:x1876270626418816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351226.018930:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3286:x1876270626418816:12345-0@lo:400:kworker.0 Request processed in 40us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351226.018936:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789351226.018965:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626419456 00000100:00100000:0.0:1789351226.018969:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626419456 00000100:00100000:0.0:1789351226.018999:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789351226.019006:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1876270626419456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351226.019035:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1876270626419456:12345-0@lo:400:kworker.0 Request processed in 31us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351226.019041:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789351226.019059:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789351226.019076:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626419456:0@lo:400:kworker.0 00000100:00100000:0.0:1789351226.019085:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626418816:0@lo:400:kworker.0 00000100:00100000:0.0:1789351226.019116:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626419072:0@lo:400:kworker.0 00000100:00100000:0.0:1789351226.019141:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351226.019159:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626419584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789351226.019180:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351226.019198:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789351226.019204:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626419200:0@lo:400:kworker.0 00000100:00100000:0.0:1789351226.019226:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351226.019264:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626419072 00000100:00100000:0.0:1789351226.019268:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626419072 00000100:00100000:0.0:1789351226.019300:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789351226.019307:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626419072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351226.019339:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626419072:12345-0@lo:400:kworker.0 Request processed in 33us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351226.019344:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789351226.019387:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626419200 00000100:00100000:0.0:1789351226.019391:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626419200 00000100:00100000:0.0:1789351226.019413:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789351226.019419:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626419200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351226.019445:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626419200:12345-0@lo:400:kworker.0 Request processed in 27us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351226.019450:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789351226.019463:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789351226.019466:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789351226.019482:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cff971880 x1876270626419200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351226.019492:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626419200:0@lo:400:kworker.0 00000100:00100000:0.0:1789351226.019502:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626419072:0@lo:400:kworker.0 00000100:00100000:0.0:1789351226.019522:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626419584 00000100:00100000:0.0:1789351226.019525:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626419584 00000100:00100000:0.0:1789351226.019546:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789351226.019552:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626419584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789351226.019576:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789351226.019603:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626419584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351226.019614:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789351226.019654:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626419584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789351226.281976:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351226.282025:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351226.282046:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616957440 00000100:00100000:2.0:1789351226.282056:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616957440 00000100:00100000:1.0:1789351226.282090:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351226.282112:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351226.282121:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616957696 00000100:00100000:2.0:1789351226.282124:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616957696 00000100:00100000:2.0:1789351226.282149:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:2.0:1789351226.282160:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+5:2347:x1876270616957440:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789351226.282161:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:1.0:1789351226.282168:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2347:x1876270616957696:12345-192.168.201.52@tcp:400:kworker.0 00000100:00080000:0.0:1789351226.282266:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351226.282278:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616957312 00000100:00100000:0.0:1789351226.282278:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616957568 00000100:00100000:3.0:1789351226.282281:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616957312 00000100:00100000:0.0:1789351226.282281:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616957568 00000100:00100000:3.0:1789351226.282309:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 250 00000100:00100000:0.0:1789351226.282312:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:3.0:1789351226.282315:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2348:x1876270616957312:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351226.282317:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff970700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+5:2348:x1876270616957568:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789351226.282393:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2347:x1876270616957696:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 225us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351226.282397:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+5:2347:x1876270616957440:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 240us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351226.282401:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:2.0:1789351226.282404:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00080000:1.0:1789351226.282505:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789351226.282690:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2348:x1876270616957312:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 373us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351226.282690:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff970700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+5:2348:x1876270616957568:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 371us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351226.282698:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:3.0:1789351226.282707:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 250 00010000:00010000:3.0:1789351226.337552:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351227.361558:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789351228.106930:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1789351228.385525:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351229.090828:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626419712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789351229.090904:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351229.090963:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626419712 00000100:00100000:0.0:1789351229.090979:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626419712 00000100:00100000:0.0:1789351229.091075:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789351229.091082:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789351229.091090:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626419712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789351229.091143:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789351229.091234:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626419712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351229.091244:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1789351229.091286:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf9d8d180 x1876270626419712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351229.091308:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626419712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789351229.409816:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351230.433599:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351231.137677:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626420224:0@lo:400:kworker.0 00000100:00100000:0.0:1789351231.137677:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626419840:0@lo:400:kworker.0 00000100:00100000:2.0:1789351231.137791:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626420096:0@lo:400:kworker.0 00000100:00100000:3.0:1789351231.137869:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876270626419968:0@lo:400:kworker.0 00000100:00100000:1.0:1789351231.139043:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351231.139163:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351231.139172:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626420224 00000100:00100000:1.0:1789351231.139182:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626420224 00000100:00100000:0.0:1789351231.139195:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876270626420352:0@lo:400:kworker.0 00000100:00100000:0.0:1789351231.139228:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351231.139247:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789351231.139260:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626420224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351231.139261:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626419840 00000100:00100000:0.0:1789351231.139264:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626419840 00000100:00100000:0.0:1789351231.139298:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789351231.139323:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3286:x1876270626419840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351231.139351:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351231.139392:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626420608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789351231.139394:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3286:x1876270626419840:12345-0@lo:400:kworker.0 Request processed in 72us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351231.139402:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789351231.139418:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351231.139438:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626420352 00000100:00100000:0.0:1789351231.139442:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626420352 00000100:00100000:2.0:1789351231.139449:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626420608 00000100:00100000:2.0:1789351231.139452:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626420608 00000100:00100000:2.0:1789351231.139479:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789351231.139486:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626420608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789351231.139532:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789351231.139584:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626420608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351231.139591:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789351231.139628:0:3288:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1789351231.139634:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2cf69f5c00, transno 4294967300 00000100:00100000:2.0:1789351231.139654:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626420608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789351231.139957:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626420224:12345-0@lo:400:kworker.0 Request processed in 699us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351231.139964:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789351231.139983:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789351231.139989:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789351231.139992:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789351231.140007:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626420096 00000100:00100000:0.0:1789351231.140011:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626420096 00010000:00080000:1.0:1789351231.140016:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cff971500 x1876270626420224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351231.140030:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626420224:0@lo:400:kworker.0 00000100:00100000:0.0:1789351231.140038:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789351231.140045:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876270626420352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351231.140060:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789351231.140067:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626420096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351231.140101:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626420096:12345-0@lo:400:kworker.0 Request processed in 34us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351231.140107:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789351231.140134:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626419840:0@lo:400:kworker.0 00000100:00100000:1.0:1789351231.140156:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876270626420352:0@lo:400:kworker.0 00000100:00100000:1.0:1789351231.140183:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626420096:0@lo:400:kworker.0 00000100:00080000:1.0:1789351231.140202:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789351231.140499:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876270626420352:12345-0@lo:400:kworker.0 Request processed in 37us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351231.140507:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789351231.140729:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351231.140762:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626420480:0@lo:400:kworker.0 00000100:00100000:3.0:1789351231.140794:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351231.140934:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626419968 00000100:00100000:1.0:1789351231.140940:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626419968 00000100:00100000:1.0:1789351231.141024:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789351231.141033:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876270626419968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351231.141087:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876270626419968:12345-0@lo:400:kworker.0 Request processed in 55us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351231.141093:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789351231.141152:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876270626419968:0@lo:400:kworker.0 00000100:00100000:2.0:1789351231.141213:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626420480 00000100:00100000:2.0:1789351231.141217:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626420480 00000100:00100000:2.0:1789351231.141254:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789351231.141262:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626420480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351231.141310:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626420480:12345-0@lo:400:kworker.0 Request processed in 50us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351231.141317:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789351231.141424:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626420480:0@lo:400:kworker.0 00000100:00100000:2.0:1789351231.403548:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351231.403617:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351231.403640:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616957952 00000100:00100000:2.0:1789351231.403652:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351231.403658:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616957952 00000100:00100000:2.0:1789351231.403691:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351231.403737:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616958080 00000100:00100000:3.0:1789351231.403745:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616957824 00000100:00100000:2.0:1789351231.403747:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616958080 00000100:00100000:3.0:1789351231.403756:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616957824 00000100:00100000:0.0:1789351231.403759:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616958208 00000100:00100000:0.0:1789351231.403765:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616958208 00000100:00100000:0.0:1789351231.403819:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:3.0:1789351231.403824:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 252 00000100:00100000:2.0:1789351231.403840:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:0.0:1789351231.403843:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+5:2347:x1876270616957952:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351231.403844:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd82c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2348:x1876270616957824:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351231.403858:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+5:2348:x1876270616958080:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351231.403961:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd82c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2348:x1876270616957824:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 122us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351231.403961:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+5:2347:x1876270616957952:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 125us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351231.403966:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+5:2348:x1876270616958080:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 110us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351231.403992:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:2.0:1789351231.403999:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:3.0:1789351231.404009:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 252 00000100:00100000:0.0:1789351231.404034:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:0.0:1789351231.404049:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2347:x1876270616958208:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351231.404090:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2347:x1876270616958208:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 47us (399us total) trans 0 rc 0/0 00000100:00080000:3.0:1789351231.404099:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789351231.404108:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789351231.404109:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 66 00010000:00010000:2.0:1789351231.457541:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351232.482665:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789351233.250996:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789351233.505610:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351234.210084:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626420736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789351234.210193:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351234.210894:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626420736 00000100:00100000:3.0:1789351234.210907:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626420736 00000100:00100000:3.0:1789351234.210998:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789351234.211012:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626420736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789351234.211059:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789351234.211152:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789351234.214076:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626420736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3052us (3868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351234.214096:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789351234.215076:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cf9d8d500 x1876270626420736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351234.215109:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626420736:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789351234.529570:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351235.553518:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351236.257751:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626420864:0@lo:400:kworker.0 00000100:00100000:0.0:1789351236.257756:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626420992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789351236.258036:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351236.258280:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876270626421120:0@lo:400:kworker.0 00000100:00100000:3.0:1789351236.258290:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876270626421248:0@lo:400:kworker.0 00000100:00100000:3.0:1789351236.258347:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351236.258428:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626421248 00000100:00100000:2.0:1789351236.258439:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626421248 00000100:00100000:3.0:1789351236.258467:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351236.258523:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626421120 00000100:00100000:3.0:1789351236.258526:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626421632:0@lo:400:kworker.0 00000100:00100000:2.0:1789351236.258529:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626421120 00000100:00100000:3.0:1789351236.258587:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351236.258588:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789351236.258608:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876270626421248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351236.258651:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789351236.258670:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876270626421120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351236.258695:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876270626421248:12345-0@lo:400:kworker.0 Request processed in 90us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351236.258707:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1789351236.258792:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789351236.258816:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626421632 00000100:00100000:2.0:1789351236.258821:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626421632 00000100:00100000:2.0:1789351236.258853:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789351236.258862:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626421632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351236.258981:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876270626421120:12345-0@lo:400:kworker.0 Request processed in 318us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351236.258991:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789351236.259056:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876270626421248:0@lo:400:kworker.0 00000100:00100000:2.0:1789351236.259074:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626421632:12345-0@lo:400:kworker.0 Request processed in 210us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351236.259085:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789351236.259113:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876270626421120:0@lo:400:kworker.0 00000100:00080000:2.0:1789351236.259120:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789351236.259156:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626420864 00000100:00100000:2.0:1789351236.259163:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626420864 00000100:00100000:3.0:1789351236.259168:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626421632:0@lo:400:kworker.0 00000100:00100000:2.0:1789351236.259201:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789351236.259212:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ce9d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3286:x1876270626420864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351236.259251:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ce9d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3286:x1876270626420864:12345-0@lo:400:kworker.0 Request processed in 41us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351236.259257:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789351236.259333:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626421376:0@lo:400:kworker.0 00000100:00100000:1.0:1789351236.259387:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351236.259545:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626420864:0@lo:400:kworker.0 00000100:00100000:1.0:1789351236.259560:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789351236.259566:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876270626421504:0@lo:400:kworker.0 00000100:00100000:1.0:1789351236.259591:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351236.259679:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626421504 00000100:00100000:3.0:1789351236.259684:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626421504 00000100:00080000:1.0:1789351236.259819:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351236.259857:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789351236.259866:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876270626421504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351236.259913:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876270626421504:12345-0@lo:400:kworker.0 Request processed in 49us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351236.259919:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789351236.259987:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876270626421504:0@lo:400:kworker.0 00000100:00100000:2.0:1789351236.260021:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626421376 00000100:00100000:2.0:1789351236.260025:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626421376 00000100:00100000:2.0:1789351236.260095:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789351236.260102:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626421376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351236.260138:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626421376:12345-0@lo:400:kworker.0 Request processed in 38us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351236.260144:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1789351236.260274:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789351236.260297:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc47c1880 x1876270626421376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351236.260308:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626421376:0@lo:400:kworker.0 00000100:00100000:0.0:1789351236.261158:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351236.261231:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626420992 00000100:00100000:1.0:1789351236.261237:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626420992 00000100:00100000:1.0:1789351236.261276:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789351236.261282:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626420992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789351236.261311:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789351236.261352:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626420992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351236.261371:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789351236.261541:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626420992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789351236.522046:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351236.522588:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351236.522627:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351236.522693:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616958336 00000100:00100000:0.0:1789351236.522720:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616958336 00000100:00100000:0.0:1789351236.522802:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 254 00000100:00100000:0.0:1789351236.522814:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ce9d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2348:x1876270616958336:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351236.522907:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ce9d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2348:x1876270616958336:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 96us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351236.522916:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 254 00000100:00100000:2.0:1789351236.524133:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351236.524202:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616958592 00000100:00100000:1.0:1789351236.524210:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616958592 00000100:00100000:1.0:1789351236.524268:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:1.0:1789351236.524277:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+5:2348:x1876270616958592:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789351236.524337:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+5:2348:x1876270616958592:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 61us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351236.524344:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:3.0:1789351236.524432:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616958464 00000100:00100000:3.0:1789351236.524438:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616958464 00000100:00080000:2.0:1789351236.524501:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789351236.524507:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789351236.524855:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616958720 00000100:00100000:0.0:1789351236.524860:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616958720 00000100:00100000:0.0:1789351236.524937:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:0.0:1789351236.524945:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+5:2347:x1876270616958464:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351236.524988:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+5:2347:x1876270616958464:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 45us (2960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351236.524995:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:0.0:1789351236.525007:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:0.0:1789351236.525013:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2347:x1876270616958720:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351236.525034:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2347:x1876270616958720:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 22us (2407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351236.525040:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00080000:2.0:1789351236.525578:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789351236.577693:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351237.601530:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351238.625749:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351239.329678:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789351239.329699:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626421760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789351239.329769:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351239.329823:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626421760 00000100:00100000:1.0:1789351239.329966:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626421760 00000100:00100000:1.0:1789351239.330069:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789351239.330081:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626421760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789351239.330117:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789351239.330180:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626421760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351239.330189:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789351239.330207:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cd1623480 x1876270626421760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351239.330222:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626421760:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789351239.330349:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789351239.649506:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351240.675566:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351241.377942:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626421888:0@lo:400:kworker.0 00000100:00100000:1.0:1789351241.378014:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351241.378061:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876270626422400:0@lo:400:kworker.0 00000100:00100000:1.0:1789351241.378088:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351241.378112:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789351241.378119:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626422016:0@lo:400:kworker.0 00000100:00100000:1.0:1789351241.378142:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351241.378159:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626422528:0@lo:400:kworker.0 00000100:00100000:1.0:1789351241.378186:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351241.378215:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626422144:0@lo:400:kworker.0 00000100:00100000:1.0:1789351241.378236:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351241.378257:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789351241.378263:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626422272:0@lo:400:kworker.0 00000100:00100000:1.0:1789351241.378281:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351241.378314:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626422400 00000100:00100000:1.0:1789351241.378322:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626422400 00000100:00100000:1.0:1789351241.378404:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626422016 00000100:00100000:1.0:1789351241.378408:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626422016 00000100:00100000:1.0:1789351241.378427:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626422144 00000100:00100000:1.0:1789351241.378429:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626422144 00000100:00100000:1.0:1789351241.378445:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789351241.378453:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876270626422400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351241.378506:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876270626422400:12345-0@lo:400:kworker.0 Request processed in 53us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351241.378523:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789351241.378541:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789351241.378547:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626422016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351241.378577:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626422016:12345-0@lo:400:kworker.0 Request processed in 30us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351241.378582:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789351241.378592:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789351241.378598:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626422144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351241.378625:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626422144:12345-0@lo:400:kworker.0 Request processed in 27us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351241.378841:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626421888 00000100:00100000:2.0:1789351241.378845:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626421888 00000100:00100000:2.0:1789351241.378875:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789351241.378882:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ce9d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3286:x1876270626421888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351241.378917:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ce9d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3286:x1876270626421888:12345-0@lo:400:kworker.0 Request processed in 36us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351241.378923:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789351241.378950:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626422528 00000100:00100000:2.0:1789351241.378954:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626422528 00000100:00100000:2.0:1789351241.378977:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626422272 00000100:00100000:2.0:1789351241.378980:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626422272 00000100:00100000:2.0:1789351241.379001:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789351241.379015:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626422528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351241.379042:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626422528:12345-0@lo:400:kworker.0 Request processed in 30us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351241.379048:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789351241.379057:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789351241.379061:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626422272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351241.379081:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626422272:12345-0@lo:400:kworker.0 Request processed in 20us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351241.379086:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789351241.379101:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789351241.379105:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789351241.379107:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789351241.379112:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789351241.379120:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd1622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626422656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789351241.379147:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351241.379183:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626422656 00000100:00100000:2.0:1789351241.379186:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626422656 00000100:00100000:2.0:1789351241.379208:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789351241.379213:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626422656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789351241.379239:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789351241.379275:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626422656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351241.379280:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789351241.379328:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd1622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626422656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789351241.380533:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789351241.380598:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626422016:0@lo:400:kworker.0 00000100:00100000:1.0:1789351241.380611:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626422528:0@lo:400:kworker.0 00000100:00100000:1.0:1789351241.380620:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626421888:0@lo:400:kworker.0 00000100:00100000:1.0:1789351241.381448:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876270626422400:0@lo:400:kworker.0 00010000:00080000:1.0:1789351241.381505:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc6f67100 x1876270626422272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789351257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351241.381517:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626422272:0@lo:400:kworker.0 00000100:00100000:1.0:1789351241.381531:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626422144:0@lo:400:kworker.0 00000100:00100000:2.0:1789351241.642449:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351241.642758:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616958976 00000100:00100000:1.0:1789351241.642768:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616958976 00000100:00100000:1.0:1789351241.642850:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00100000:1.0:1789351241.642874:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+5:2347:x1876270616958976:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789351241.642948:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+5:2347:x1876270616958976:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 76us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351241.642956:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00080000:2.0:1789351241.643016:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789351241.644353:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351241.644465:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616958848 00000100:00100000:3.0:1789351241.644473:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616958848 00000100:00100000:3.0:1789351241.644620:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 256 00000100:00100000:3.0:1789351241.644639:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2347:x1876270616958848:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351241.644704:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2347:x1876270616958848:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 76us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351241.644710:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 256 00000100:00100000:2.0:1789351241.669845:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351241.670127:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351241.670167:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616959232 00000100:00100000:2.0:1789351241.670178:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616959232 00000100:00100000:2.0:1789351241.670260:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:2.0:1789351241.670273:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2348:x1876270616959232:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351241.670414:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2348:x1876270616959232:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 144us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351241.670425:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:0.0:1789351241.671098:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616959104 00000100:00100000:0.0:1789351241.671107:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616959104 00000100:00100000:0.0:1789351241.671160:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:0.0:1789351241.671170:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+5:2346:x1876270616959104:12345-192.168.201.52@tcp:9:kworker.0 00000020:00000080:0.0:1789351241.671198:0:6660:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6dab 00000100:00080000:0.0:1789351241.671207:0:6660:0:(import.c:65:import_set_state_nolock()) ffff8d2d00bf8800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789351241.671255:0:6660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1789351241.672691:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+2:2346:x1876270616959104:12345-192.168.201.52@tcp:9:kworker.0 Request processed in 1513us (2848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351241.672704:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00010000:00010000:0.0:1789351241.672739:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789351241.677224:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789351241.677234:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789351241.697551:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351242.721504:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789351243.478807:0:7616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8237986d-b9e8-417a-ac8f-a078390d268c 00000020:00000080:3.0:1789351243.478815:0:7616:0:(genops.c:906:class_export_put()) final put ffff8d2d00bfa000/8237986d-b9e8-417a-ac8f-a078390d268c 00000020:00000080:0.0:1789351243.481519:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2d00bfa000/8237986d-b9e8-417a-ac8f-a078390d268c for lustre-OST0001 00000020:00000080:0.0:1789351243.481601:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2d00bf8800 for lustre-OST0001 00000040:00080000:0.0:1789351243.491254:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1789351243.494969:0:11813:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:00:42 (1789351242) 00010000:00010000:0.0:1789351243.746894:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351244.449610:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626422784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789351244.449682:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351244.449781:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626422784 00000100:00100000:2.0:1789351244.449788:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626422784 00000100:00100000:2.0:1789351244.449839:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789351244.449847:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626422784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789351244.449875:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789351244.449909:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626422784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351244.449913:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1789351244.449980:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789351244.450047:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cc47fdf80 x1876270626422784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351244.450070:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626422784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789351244.667235:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351244.667536:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616959360 00000100:00100000:0.0:1789351244.667550:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616959360 00000100:00080000:3.0:1789351244.667627:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789351244.667655:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:0.0:1789351244.667671:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:10213:x1876270616959360:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789351244.667699:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351244.667725:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df6e76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c8e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351244.667799:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df6e7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351244.667812:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df6e7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351244.667824:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df6e7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351244.668074:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789351244.668080:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789351244.668250:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df6e7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351244.668282:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df6e76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c8e expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351244.668303:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df6e7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c8e expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351244.668326:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc886ec00) 00010000:00010000:0.0:1789351244.668329:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789351244.668334:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0030800, rc 0) 00000100:00100000:0.0:1789351244.668639:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+6:10213:x1876270616959360:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 972us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351244.668648:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:2.0:1789351244.684276:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351244.684412:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616959488 00000100:00100000:3.0:1789351244.684445:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616959488 00000100:00100000:3.0:1789351244.684551:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:3.0:1789351244.684564:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:10214:x1876270616959488:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351244.684594:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351244.684622:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6e84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c95 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.684723:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6e8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.684740:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6e8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.684753:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6e8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.684769:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df6e92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.684777:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df6e92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.684783:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df6e92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685281:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104800/0xa6ea017771df6e99 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685292:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104800/0xa6ea017771df6e99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685299:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104800/0xa6ea017771df6e99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351244.685441:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1789351244.685446:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351244.685532:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104800/0xa6ea017771df6e99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685548:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6e8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685556:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6e8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685564:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6e8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685572:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351244.685576:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6e8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685585:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6e8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685599:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc886ec00) 00010000:00010000:3.0:1789351244.685602:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351244.685608:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6e8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685615:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6e8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685629:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df6e92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685647:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df6e92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685653:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df6e92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685659:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351244.685662:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df6e92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685669:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df6e92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685678:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d2ce058f800) 00010000:00010000:3.0:1789351244.685681:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351244.685684:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df6e92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685690:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df6e92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685730:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6e84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c95 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685745:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104800/0xa6ea017771df6e99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c95 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351244.685753:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2ce058fe00) 00010000:00010000:3.0:1789351244.685756:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789351244.685764:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104800, rc 0) 00000100:00100000:3.0:1789351244.685855:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+7:10214:x1876270616959488:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1292us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351244.685864:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:2.0:1789351244.689033:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351244.689196:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616959744 00000100:00100000:1.0:1789351244.689209:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616959744 00000100:00100000:1.0:1789351244.689281:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:1.0:1789351244.689292:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+7:10214:x1876270616959744:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789351244.689322:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351244.689392:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df6ea0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7c9c expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.689489:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df6ea7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.689506:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df6ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.689519:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df6ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.689535:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df6eae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.689543:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df6eae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.689570:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df6eae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.690521:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5c00/0xa6ea017771df6eb5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.690535:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5c00/0xa6ea017771df6eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.690544:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5c00/0xa6ea017771df6eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351244.690555:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1789351244.690944:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df6ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.690953:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df6ea7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.690961:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df6ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.690967:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351244.690972:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df6ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.690980:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df6ea7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.690994:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2ce058fe00) 00010000:00010000:1.0:1789351244.690997:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351244.691006:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df6ea7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.691013:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df6ea7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.691026:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df6eae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.691032:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df6eae lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.691038:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df6eae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.691043:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351244.691046:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df6eae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.691052:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df6eae lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.691059:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d2cc3d1c500) 00010000:00010000:1.0:1789351244.691061:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351244.691064:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df6eae lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.691070:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df6eae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.692574:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df6ea0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c9c expref: 10 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.692611:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5c00/0xa6ea017771df6eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c9c expref: 9 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351244.692620:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2cc3d1c800) 00010000:00010000:1.0:1789351244.692623:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351244.692626:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5c00, rc 0) 00000100:00100000:1.0:1789351244.692782:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+9:10214:x1876270616959744:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 3490us (3762us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789351244.692792:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:1.0:1789351244.700977:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351244.701064:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616959872 00000100:00100000:0.0:1789351244.701077:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616959872 00000100:00100000:0.0:1789351244.701167:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:0.0:1789351244.701180:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+9:10214:x1876270616959872:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789351244.701335:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+9:10214:x1876270616959872:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 Request processed in 156us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351244.701353:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00010000:00010000:3.0:1789351244.771090:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789351245.538172:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789351245.793620:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351245.887137:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351245.887184:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616960000 00000100:00100000:3.0:1789351245.887198:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616960000 00000100:00100000:3.0:1789351245.887264:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:3.0:1789351245.887276:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+9:10256:x1876270616960000:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351245.887303:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351245.887336:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df6ec3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7ca3 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887447:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6eca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887465:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6eca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887477:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6eca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887494:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6ed1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887501:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887508:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887806:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6eca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887813:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6eca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887818:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6eca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887822:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351245.887826:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6eca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887832:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6eca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887843:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc886ec00) 00010000:00010000:3.0:1789351245.887846:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351245.887850:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6eca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887854:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6eca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887867:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887873:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887879:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887891:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351245.887894:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887902:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6ed1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887908:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d2ce058f800) 00010000:00010000:3.0:1789351245.887910:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351245.887913:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6ed1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887917:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6ed1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887951:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df6ec3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ca3 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887962:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc886ec00) 00010000:00010000:3.0:1789351245.887964:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351245.887967:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df6ec3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ca3 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.887976:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105200, rc 0) 00000100:00100000:3.0:1789351245.888063:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+9:10256:x1876270616960000:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 790us (935us total) trans 0 rc 301/301 00000100:00100000:3.0:1789351245.888072:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:3.0:1789351245.891251:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351245.891309:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616960256 00000100:00100000:2.0:1789351245.891332:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616960256 00000100:00100000:2.0:1789351245.891580:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:2.0:1789351245.891594:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+9:10256:x1876270616960256:12345-192.168.201.52@tcp:36:lfs.0 00010000:00010000:2.0:1789351245.891668:0:9467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351245.891701:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df6e7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c8e expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.891738:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc886ec00) 00010000:00010000:2.0:1789351245.891751:0:9467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351245.892076:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6ed8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.892091:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6ed8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.892102:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6ed8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.892115:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df6edf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.892123:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df6edf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.892129:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df6edf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351245.893294:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1789351245.893311:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6ed8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.893332:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6ed8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.893341:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6ed8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.893348:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351245.893381:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6ed8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.893391:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6ed8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.893404:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a200) 00010000:00010000:2.0:1789351245.893408:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351245.893414:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6ed8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.893420:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6ed8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789351245.893437:0:9467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a83efa5 reply state 000000007b2dbcf0 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df6edf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351245.893446:0:9467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789351245.893592:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+10:10256:x1876270616960256:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 1997us (2346us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789351245.893602:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00010000:00010000:1.0:1789351245.896496:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df6edf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351245.896515:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df6edf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351245.896523:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df6edf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351245.896530:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351245.896535:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df6edf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351245.896542:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df6edf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351245.896582:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d2ce9e1ac00) 00010000:00010000:1.0:1789351245.896584:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351245.896589:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df6edf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351245.896595:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df6edf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351245.943961:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351245.944182:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616960384 00000100:00100000:2.0:1789351245.944210:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616960384 00000100:00100000:2.0:1789351245.944327:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:2.0:1789351245.944354:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+9:10264:x1876270616960384:12345-192.168.201.52@tcp:101:lctl.0 00010000:00010000:2.0:1789351245.944462:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351245.944581:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6ee6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7caa expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.946223:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df6eed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.946302:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df6eed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.946468:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df6eed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351245.946763:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789351245.946769:0:10562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351245.946884:0:10562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df6eed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.946932:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6ee6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7caa expref: 11 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.946959:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df6eed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7caa expref: 10 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.946970:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a200) 00010000:00010000:2.0:1789351245.946973:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789351245.946978:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0a00, rc 0) 00000100:00100000:2.0:1789351245.947073:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+10:10264:x1876270616960384:12345-192.168.201.52@tcp:101:lctl.0 Request processed in 2734us (3156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351245.947084:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:2.0:1789351245.987835:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351245.987917:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616960512 00000100:00100000:3.0:1789351245.987932:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616960512 00000100:00100000:3.0:1789351245.987992:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:3.0:1789351245.988004:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+10:10270:x1876270616960512:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789351245.988042:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351245.988068:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df6ef4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7cb1 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.988156:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6efb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.988174:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6efb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.988188:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6efb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.988205:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6f02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.988210:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6f02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351245.988215:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6f02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988527:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6f09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988533:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988557:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351245.988599:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1789351245.988604:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351245.988645:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988657:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6efb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988664:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6efb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988672:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6efb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988678:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351245.988684:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6efb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988692:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6efb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988706:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a200) 00010000:00010000:2.0:1789351245.988709:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351245.988713:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6efb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988718:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df6efb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988737:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6f02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988741:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6f02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988745:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6f02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988748:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351245.988749:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6f02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988753:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6f02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988757:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d2ce058f800) 00010000:00010000:2.0:1789351245.988758:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351245.988760:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6f02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988763:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df6f02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988788:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df6ef4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cb1 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988806:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cb1 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351245.988820:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:2.0:1789351245.988822:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789351245.988824:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1c00, rc 0) 00000100:00100000:2.0:1789351245.988889:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+11:10270:x1876270616960512:12345-192.168.201.52@tcp:101:bash.0 Request processed in 887us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351245.988896:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:3.0:1789351245.991072:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351245.991568:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616960768 00000100:00100000:0.0:1789351245.991582:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616960768 00000100:00100000:0.0:1789351245.991654:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:0.0:1789351245.991667:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+11:10270:x1876270616960768:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789351245.991695:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351245.991721:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df6f10 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7cb8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.991972:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df6f17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.993096:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df6f17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.993108:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df6f17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.995490:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df6f1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.995517:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df6f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.995533:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df6f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789351245.997422:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789351245.997616:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df6f25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.997632:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df6f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.997643:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df6f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.997682:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df6f17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.997689:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df6f17 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.997696:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df6f17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.997710:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351245.997715:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df6f17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.997723:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df6f17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.997736:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:0.0:1789351245.997739:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351245.997743:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df6f17 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.997749:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df6f17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789351245.997764:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000995e9767 reply state 0000000087019986 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df6f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351245.997773:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789351245.997815:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df6f10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cb8 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.997831:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df6f25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cb8 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351245.997838:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2cc886e900) 00010000:00010000:0.0:1789351245.997841:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789351245.997844:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0031600, rc 0) 00000100:00100000:0.0:1789351245.997929:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+14:10270:x1876270616960768:12345-192.168.201.52@tcp:101:bash.0 Request processed in 6264us (6872us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789351245.997945:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00010000:00010000:1.0:1789351245.999793:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df6f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351245.999808:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df6f1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351245.999815:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df6f1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351245.999821:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351245.999825:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df6f1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351245.999833:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df6f1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351245.999848:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2cc886e300) 00010000:00010000:1.0:1789351245.999851:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351245.999854:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df6f1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351245.999860:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df6f1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351246.004157:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351246.004259:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616960896 00000100:00100000:2.0:1789351246.004274:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616960896 00000100:00100000:2.0:1789351246.004341:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:2.0:1789351246.004353:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1876270616960896:12345-192.168.201.52@tcp:8:bash.0 00010000:00080000:2.0:1789351246.004443:0:6661:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1789351246.004483:0:6661:0:(genops.c:1406:class_connect()) connect: client 8237986d-b9e8-417a-ac8f-a078390d268c, cookie 0xa6ea017771df6f33 00002000:00100000:2.0:1789351246.004499:0:6661:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8237986d-b9e8-417a-ac8f-a078390d268c/ffff8d2cc517b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789351246.004531:0:6661:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789351246.004891:0:6661:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789351246.004930:0:6661:0:(import.c:65:import_set_state_nolock()) ffff8d2cc517e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789351246.005037:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:2346:x1876270616960896:12345-192.168.201.52@tcp:8:bash.0 Request processed in 685us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351246.005047:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:3.0:1789351246.009201:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351246.009335:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616961024 00000100:00100000:0.0:1789351246.009354:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616961024 00000100:00100000:0.0:1789351246.009485:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00080000:3.0:1789351246.009490:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789351246.009501:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+6:0:x1876270616961024:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789351246.009525:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351246.009554:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df6f3a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7cbf expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789351246.009585:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351246.009605:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=190s v=(0 0) 00010000:00010000:0.0:1789351246.009610:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351246.009622:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df6f3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cbf expref: 7 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.009642:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df6f3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cbf expref: 7 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.009659:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0031200, rc 0) 00000100:00100000:0.0:1789351246.009732:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+7:0:x1876270616961024:12345-192.168.201.52@tcp:101:bash.0 Request processed in 237us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351246.009740:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:3.0:1789351246.013701:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351246.013968:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616961152 00000100:00100000:2.0:1789351246.013981:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616961152 00000100:00100000:2.0:1789351246.014118:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:2.0:1789351246.014131:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+7:10270:x1876270616961152:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789351246.014156:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351246.014203:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7cc6 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.014246:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df6f3a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cbf expref: 8 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.014450:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351246.014457:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351246.014464:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cc6 expref: 8 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.014519:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df6f3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cbf expref: 8 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.014539:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df6f3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cbf expref: 8 pid: 6660 timeout: 290 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351246.014572:0:6661:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1876270626422912:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351246.014763:0:6661:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2ad3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789351246.017497:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351246.017592:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616961280 00000100:00100000:0.0:1789351246.017604:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616961280 00010000:00010000:0.0:1789351246.017657:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df6f3a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cbf expref: 9 pid: 6660 timeout: 290 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351246.017740:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:0.0:1789351246.017754:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+9:2348:x1876270616961280:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351246.017777:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351246.017807:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df6f3a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cbf expref: 9 pid: 6660 timeout: 290 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.017824:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df6f3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cbf expref: 9 pid: 6660 timeout: 290 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.017856:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351246.017861:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351246.017871:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cc6 expref: 9 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.017884:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cc6 expref: 9 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.017931:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cc6 expref: 9 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351246.017950:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5808:1876270626423040:192.168.201.52@tcp:105: 00010000:00010000:2.0:1789351246.018134:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df6f3a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cbf expref: 9 pid: 6660 timeout: 290 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351246.018155:0:6661:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1876270626422912:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351246.018187:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cc6 expref: 8 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.018215:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1000, rc 0) 00000100:00100000:0.0:1789351246.018284:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc604c000 going to sleep for 11 seconds 00000100:00100000:2.0:1789351246.018621:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+8:10270:x1876270616961152:12345-192.168.201.52@tcp:101:bash.0 Request processed in 4491us (4933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351246.018630:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:2.0:1789351246.022729:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351246.022873:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616961536 00000100:00100000:3.0:1789351246.022886:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616961536 00000100:00100000:0.0:1789351246.022921:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf69f6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5808:1876270626423040:192.168.201.52@tcp:105: 00010000:00010000:0.0:1789351246.022971:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351246.022972:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:3.0:1789351246.022986:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+13:10270:x1876270616961536:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:0.0:1789351246.023041:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+7:2348:x1876270616961280:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 5291us (5563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351246.023050:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00080000:2.0:1789351246.023286:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351246.023484:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+14:10270:x1876270616961536:12345-192.168.201.52@tcp:35:bash.0 Request processed in 501us (769us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789351246.023492:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:2.0:1789351246.070753:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351246.071029:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616961792 00000100:00100000:1.0:1789351246.071043:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616961792 00000100:00100000:1.0:1789351246.071116:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:1.0:1789351246.071130:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+14:10280:x1876270616961792:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789351246.071163:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351246.071189:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6f48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7ccd expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351246.071338:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1789351246.071642:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6f48 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ccd expref: 16 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.071660:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a200) 00010000:00010000:1.0:1789351246.071663:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789351246.071667:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6f48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ccd expref: 16 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.071680:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4200, rc 0) 00000100:00100000:1.0:1789351246.071759:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+15:10280:x1876270616961792:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 632us (1023us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1789351246.071767:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:2.0:1789351246.075600:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351246.075659:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616962048 00000100:00100000:1.0:1789351246.075672:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616962048 00000100:00100000:1.0:1789351246.075798:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:1.0:1789351246.075812:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+15:10280:x1876270616962048:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789351246.076154:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+16:10280:x1876270616962048:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 344us (565us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789351246.076179:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1789351246.121225:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351246.121412:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616962176 00000100:00100000:2.0:1789351246.121426:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616962176 00000100:00100000:2.0:1789351246.121503:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:2.0:1789351246.121516:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+16:10286:x1876270616962176:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351246.121552:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351246.121834:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6f56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7cd4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.121929:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df6f5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.121946:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df6f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.121960:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df6f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351246.122041:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1789351246.122046:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351246.122096:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df6f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.122131:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6f56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cd4 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.122154:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df6f5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cd4 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.122164:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:2.0:1789351246.122167:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789351246.122171:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1200, rc 0) 00000100:00100000:2.0:1789351246.122407:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+17:10286:x1876270616962176:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 893us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351246.122415:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:2.0:1789351246.127442:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351246.128057:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616962432 00000100:00100000:0.0:1789351246.128070:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616962432 00000100:00100000:0.0:1789351246.128195:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:0.0:1789351246.128208:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+17:10286:x1876270616962432:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789351246.128239:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351246.128268:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df6f64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7cdb expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.128466:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df6f6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.128486:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df6f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.128502:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df6f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351246.128515:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789351246.128780:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df6f64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cdb expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.128804:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df6f6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cdb expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.128813:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2cc886e900) 00010000:00010000:0.0:1789351246.128834:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789351246.128839:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0030800, rc 0) 00000100:00100000:0.0:1789351246.128929:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+19:10286:x1876270616962432:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 723us (1502us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789351246.128937:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:3.0:1789351246.131520:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351246.133392:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351246.133427:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616962816 00000100:00100000:3.0:1789351246.133446:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616962816 00000100:00100000:3.0:1789351246.133533:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:3.0:1789351246.133546:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+19:2348:x1876270616962816:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351246.133567:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351246.133601:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df6f6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cdb expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.133624:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2cc886e900) 00010000:00010000:3.0:1789351246.133629:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351246.133705:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+18:2348:x1876270616962816:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 161us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351246.133714:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:2.0:1789351246.134067:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616962688 00000100:00100000:2.0:1789351246.134075:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616962688 00000100:00100000:2.0:1789351246.134124:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:2.0:1789351246.134131:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+18:10286:x1876270616962688:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351246.134160:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351246.134179:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6f79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7ce2 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.134300:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df6f80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.134328:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df6f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.134355:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df6f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351246.134391:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789351246.134553:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6f79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ce2 expref: 21 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.134572:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df6f80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ce2 expref: 20 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.134580:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2cc886e900) 00010000:00010000:2.0:1789351246.134584:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789351246.134586:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0800, rc 0) 00000100:00100000:2.0:1789351246.134632:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+20:10286:x1876270616962688:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 502us (3128us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789351246.134640:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:3.0:1789351246.141870:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351246.142090:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616962944 00000100:00100000:2.0:1789351246.142105:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616962944 00000100:00100000:2.0:1789351246.142226:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:2.0:1789351246.142239:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+7:2348:x1876270616962944:12345-192.168.201.52@tcp:1:lfs.0 00010000:00010000:2.0:1789351246.142305:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084314b69/0xa6ea017771df6f8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.142342:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cc6 expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.142353:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351246.142400:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789351246.142405:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084314b69/0xa6ea017771df6f8e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.142462:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cc6 expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.142479:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cc6 expref: 7 pid: 6661 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351246.142498:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6660:1876270626423168:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351246.142772:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc65ce0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789351246.144901:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6660:1876270626423168:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351246.144942:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000084314b69/0xa6ea017771df6f8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351246.145717:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351246.145965:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616963072 00000100:00100000:0.0:1789351246.145977:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616963072 00002000:00100000:0.0:1789351246.146045:0:6666:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8d2cc2c6c000 x1876270616963072/t0(0) o4->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:502/0 lens 504/0 e 0 to 0 dl 1789351257 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789351246.146061:0:6666:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cc2c6c000 with x1876270616963072 ext(0->12) 00010000:00010000:0.0:1789351246.146073:0:6666:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cc6 expref: 8 pid: 6661 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.146092:0:6666:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cc6 expref: 8 pid: 6661 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789351246.146100:0:6666:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d2cc2c6c000 00000100:00100000:0.0:1789351246.146210:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:0.0:1789351246.146224:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8237986d-b9e8-417a-ac8f-a078390d268c+8:2347:x1876270616963072:12345-192.168.201.52@tcp:4:lfs.0 00000001:00100000:1.0:1789351246.177804:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8237986d-b9e8-417a-ac8f-a078390d268c 00000100:00100000:0.0:1789351246.202101:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8237986d-b9e8-417a-ac8f-a078390d268c+9:2347:x1876270616963072:12345-192.168.201.52@tcp:4:lfs.0 Request processed in 55868us (56376us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789351246.202116:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00002000:00100000:0.0:1789351246.202129:0:6666:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8d2cc2c6c000 x1876270616963072/t4294967299(0) o4->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:502/0 lens 504/448 e 0 to 0 dl 1789351257 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789351246.202141:0:6666:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cc2c6c000 with x1876270616963072 ext(0->12) 00010000:00010000:0.0:1789351246.202163:0:6666:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cc6 expref: 9 pid: 6661 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.202182:0:6666:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cc6 expref: 9 pid: 6661 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789351246.202191:0:6666:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d2cc2c6c000 00000001:00080000:1.0:1789351246.203087:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1789351246.209121:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351246.212679:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616963200 00000100:00100000:1.0:1789351246.212697:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616963200 00010000:00010000:1.0:1789351246.212761:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cc6 expref: 7 pid: 6661 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351246.212853:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:1.0:1789351246.212864:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270616963200:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351246.212880:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789351246.212900:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789351246.212904:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789351246 00002000:00010000:1.0:1789351246.212906:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789351246 00002000:00010000:1.0:1789351246.212909:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789351246 00002000:00010000:1.0:1789351246.212911:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1789351246.212917:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cc6 expref: 7 pid: 6661 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.212931:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cc6 expref: 7 pid: 6661 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.212959:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001830f7e5/0xa6ea017771df6f41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cc6 expref: 7 pid: 6661 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.212977:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789351246.212992:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789351246.212998:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000084314b69/0xa6ea017771df6f8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.213008:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084314b69/0xa6ea017771df6f8e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.213045:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351246.213110:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+6:2347:x1876270616963200:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 247us (3997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351246.213118:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00010000:00010000:2.0:1789351246.216853:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000084314b69/0xa6ea017771df6f8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.216872:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084314b69/0xa6ea017771df6f8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.216908:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084314b69/0xa6ea017771df6f8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.216917:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084314b69/0xa6ea017771df6f8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.216940:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084314b69/0xa6ea017771df6f8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.216948:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0200 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351246.216952:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084314b69/0xa6ea017771df6f8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.216960:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084314b69/0xa6ea017771df6f8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.216983:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084314b69/0xa6ea017771df6f8e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.216992:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084314b69/0xa6ea017771df6f8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351246.217092:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+5:2348:x1876270616962944:12345-192.168.201.52@tcp:1:lfs.0 Request processed in 74851us (75234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351246.217102:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:3.0:1789351246.218860:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351246.218938:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616963456 00000100:00100000:2.0:1789351246.218948:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616963456 00000100:00100000:2.0:1789351246.219001:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:2.0:1789351246.219011:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+20:10286:x1876270616963456:12345-192.168.201.52@tcp:35:lfs.0 00000004:00010000:2.0:1789351246.219073:0:5826:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df6f80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ce2 expref: 20 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789351246.219403:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1789351246.219460:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1789351246.220133:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1789351246.220187:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df6f95 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.220205:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df6f25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cb8 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.220214:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df6f95 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.220248:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df6f25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cb8 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.220264:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df6f25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cb8 expref: 24 pid: 5824 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351246.220278:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47fc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1876270626423296:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351246.220402:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc65ceb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789351246.222869:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47fc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1876270626423296:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351246.222877:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:2.0:1789351246.222900:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df6f95 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351246.222966:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616963584 00000100:00100000:0.0:1789351246.222974:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616963584 00010000:00010000:0.0:1789351246.223010:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df6f25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cb8 expref: 25 pid: 5824 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351246.223049:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:0.0:1789351246.223059:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+25:2348:x1876270616963584:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351246.223075:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351246.223081:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df6f25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cb8 expref: 25 pid: 5824 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.223093:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df6f25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cb8 expref: 25 pid: 5824 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.223112:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df6f25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cb8 expref: 25 pid: 5824 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.223127:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2cc886e900) 00010000:00010000:0.0:1789351246.223131:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df6f95 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.223158:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df6f95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.223164:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df6f95 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.223193:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351246.223247:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+24:2348:x1876270616963584:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 188us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351246.223254:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00010000:00010000:2.0:1789351246.225663:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df6f95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.225680:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df6f95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789351246.225841:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789351246.226041:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1789351246.226170:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47fc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876270626423424:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789351246.226283:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351246.226337:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc65cee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789351246.226401:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626423424 00000100:00100000:1.0:1789351246.226409:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626423424 00000100:00080000:2.0:1789351246.226495:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789351246.226524:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789351246.226535:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1876270626423424:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789351246.226626:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1876270626423424:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 92us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351246.226633:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789351246.226657:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47fc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876270626423424:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789351246.227887:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1789351246.227963:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47fc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876270626423552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789351246.228010:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351246.228041:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc604c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351246.228411:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626423552 00000100:00100000:3.0:1789351246.228419:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626423552 00000100:00100000:3.0:1789351246.228574:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789351246.228584:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5826:x1876270626423552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789351246.228835:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5826:x1876270626423552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 251us (823us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789351246.228843:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789351246.229078:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47fc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876270626423552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789351246.229137:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1789351246.229179:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df6f95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.229189:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df6f95 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.229196:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df6f95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.229203:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351246.229207:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df6f95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.229215:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df6f95 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.229254:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2cc886e900) 00010000:00010000:2.0:1789351246.229257:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789351246.229262:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df6f95 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351246.229268:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df6f95 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789351246.229467:0:5826:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789351246.229665:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789351246.229676:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 190675317313ns, next at 191675315369ns, rc = 0 00000001:00080000:2.0:1789351246.229682:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789351246.229855:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2cc886e900) 00010000:00010000:2.0:1789351246.229859:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789351246.229866:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df6f80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ce2 expref: 28 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351246.229976:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+27:10286:x1876270616963456:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 10965us (11121us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789351246.229984:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000020:00080000:2.0:1789351246.229989:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789351246.240191:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351246.240254:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616963712 00000100:00100000:2.0:1789351246.240264:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616963712 00000100:00100000:2.0:1789351246.240336:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:2.0:1789351246.240347:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+27:10286:x1876270616963712:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351246.240392:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351246.240478:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6f9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7ce9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.240544:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6f9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ce9 expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.240560:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6f9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ce9 expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.240580:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:3.0:1789351246.240583:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789351246.240587:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0200, rc 0) 00000100:00100000:3.0:1789351246.240647:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+28:10286:x1876270616963712:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 302us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351246.240653:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:3.0:1789351246.243405:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351246.243540:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616963968 00000100:00100000:1.0:1789351246.243551:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616963968 00000100:00100000:1.0:1789351246.243610:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1789351246.243621:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf03a0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+28:10286:x1876270616963968:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789351246.243850:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf03a0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+29:10286:x1876270616963968:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 231us (451us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789351246.243856:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1789351246.308805:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351246.309039:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616964224 00000100:00100000:3.0:1789351246.309061:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616964224 00000100:00100000:3.0:1789351246.309408:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:3.0:1789351246.309421:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+29:10296:x1876270616964224:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351246.309507:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351246.309527:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df6fa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7cf0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351246.309738:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1789351246.310068:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df6fa3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cf0 expref: 31 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.310083:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a200) 00010000:00010000:3.0:1789351246.310086:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789351246.310090:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df6fa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cf0 expref: 31 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.310106:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105a00, rc 0) 00000100:00100000:3.0:1789351246.310235:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+30:10296:x1876270616964224:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 816us (1439us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1789351246.310243:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:3.0:1789351246.317932:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351246.318981:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616964352 00000100:00100000:1.0:1789351246.319003:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616964352 00000100:00100000:1.0:1789351246.319128:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:1.0:1789351246.319139:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+30:10296:x1876270616964352:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:1.0:1789351246.319218:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319236:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319249:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319265:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319273:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319280:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319449:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df6fbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319458:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df6fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319465:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df6fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789351246.319507:0:10562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df6fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319532:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319539:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fb1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319547:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319553:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351246.319558:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319567:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fb1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319579:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:1.0:1789351246.319583:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351246.319588:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319595:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319607:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319614:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319620:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319632:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351246.319635:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319641:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319650:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2cc3d1c500) 00010000:00010000:1.0:1789351246.319652:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351246.319655:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319660:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319673:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df6fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319678:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df6fbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319683:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df6fbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319688:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351246.319691:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df6fbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319696:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df6fbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319714:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:1.0:1789351246.319717:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351246.319720:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df6fbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.319725:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df6fbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351246.319815:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+30:10296:x1876270616964352:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 676us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351246.319823:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:2.0:1789351246.323485:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351246.323575:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616964608 00000100:00100000:3.0:1789351246.323585:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616964608 00000100:00100000:3.0:1789351246.323645:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1789351246.323655:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+30:10296:x1876270616964608:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1789351246.324013:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+31:10296:x1876270616964608:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 358us (536us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789351246.324034:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1789351246.366309:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351246.368724:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616964864 00000100:00100000:1.0:1789351246.368737:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616964864 00000100:00100000:1.0:1789351246.368822:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:1.0:1789351246.368833:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+31:10299:x1876270616964864:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789351246.368858:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351246.368881:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df6fc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7cf7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.368958:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fcd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.368972:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.368982:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.368997:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369018:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369026:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369156:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df6fdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369164:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df6fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369170:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df6fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351246.369180:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789351246.369272:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369279:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fcd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369285:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369292:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351246.369296:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369303:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fcd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369338:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:1.0:1789351246.369341:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351246.369346:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369351:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df6fcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369476:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369484:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369490:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369496:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351246.369498:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369504:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369512:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2cc3d1c500) 00010000:00010000:1.0:1789351246.369515:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351246.369517:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fd4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.369523:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df6fd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.375478:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df6fc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cf7 expref: 34 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.375514:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df6fdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cf7 expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.375524:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:1.0:1789351246.375527:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789351246.375530:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5800, rc 0) 00000100:00100000:1.0:1789351246.375600:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+33:10299:x1876270616964864:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 6768us (9303us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1789351246.375610:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:2.0:1789351246.383871:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351246.384389:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616964992 00000100:00100000:3.0:1789351246.384399:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616964992 00000100:00100000:3.0:1789351246.384461:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:3.0:1789351246.384472:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+33:10299:x1876270616964992:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:3.0:1789351246.384544:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df6fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.384562:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df6fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.384574:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df6fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.384603:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df6fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.384609:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df6fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.384616:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df6fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.384623:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351246.384627:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df6fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.384634:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df6fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.384658:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:3.0:1789351246.384662:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789351246.384667:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df6fe9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.384674:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df6fe9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351246.384756:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+33:10299:x1876270616964992:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 285us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351246.384765:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:2.0:1789351246.390697:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351246.390759:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616965248 00000100:00100000:1.0:1789351246.390773:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616965248 00000100:00100000:1.0:1789351246.390821:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:1.0:1789351246.390829:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+33:10299:x1876270616965248:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789351246.391106:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+34:10299:x1876270616965248:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 277us (418us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1789351246.391114:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1789351246.497598:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626423808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789351246.497598:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876270626423936:0@lo:400:kworker.0 00000100:00100000:3.0:1789351246.497664:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351246.497664:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351246.498347:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626423808 00000100:00100000:1.0:1789351246.498380:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626424064:0@lo:400:kworker.0 00000100:00100000:2.0:1789351246.498381:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626423808 00000100:00100000:2.0:1789351246.498678:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789351246.498689:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626423808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789351246.498737:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789351246.498835:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626423680:0@lo:400:kworker.0 00000100:00100000:3.0:1789351246.498877:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351246.498909:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626424320:0@lo:400:kworker.0 00000100:00100000:3.0:1789351246.498933:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351246.498963:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626423680 00000100:00100000:3.0:1789351246.498973:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626423680 00000100:00100000:3.0:1789351246.499001:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789351246.499007:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3286:x1876270626423680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351246.499051:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3286:x1876270626423680:12345-0@lo:400:kworker.0 Request processed in 43us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351246.499058:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789351246.499088:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626424320 00000100:00100000:3.0:1789351246.499092:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626424320 00000100:00100000:3.0:1789351246.499127:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789351246.499133:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1876270626424320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351246.499163:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1876270626424320:12345-0@lo:400:kworker.0 Request processed in 30us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351246.499168:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789351246.499205:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626424320:0@lo:400:kworker.0 00000100:00100000:3.0:1789351246.499215:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626423680:0@lo:400:kworker.0 00000100:00080000:3.0:1789351246.499251:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789351246.499277:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876270626424192:0@lo:400:kworker.0 00000100:00100000:3.0:1789351246.499302:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351246.499344:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626423936 00000100:00100000:3.0:1789351246.499348:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626423936 00000100:00100000:3.0:1789351246.499390:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626424192 00000100:00100000:3.0:1789351246.499393:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626424192 00000100:00100000:3.0:1789351246.499417:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789351246.499590:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876270626423936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351246.499629:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876270626423936:12345-0@lo:400:kworker.0 Request processed in 205us (1965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351246.499636:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789351246.499648:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789351246.499655:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876270626424192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351246.499684:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876270626424192:12345-0@lo:400:kworker.0 Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351246.499690:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789351246.499713:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876270626424192:0@lo:400:kworker.0 00000100:00080000:3.0:1789351246.499743:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789351246.500226:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876270626423936:0@lo:400:kworker.0 00000100:00100000:1.0:1789351246.505869:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351246.506034:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626423808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7344us (8366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351246.506047:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789351246.506082:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626423808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789351246.511435:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626424064 00000100:00100000:3.0:1789351246.511452:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626424064 00000100:00100000:3.0:1789351246.511635:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789351246.511647:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626424064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351246.511766:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626424064:12345-0@lo:400:kworker.0 Request processed in 121us (5902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351246.511773:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789351246.512203:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626424064:0@lo:400:kworker.0 00000100:00080000:0.0:1789351246.513269:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789351246.544194:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351246.544702:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616965504 00000100:00100000:3.0:1789351246.544712:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616965504 00000100:00100000:3.0:1789351246.544783:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:3.0:1789351246.544795:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+34:10330:x1876270616965504:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:3.0:1789351246.544822:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351246.544843:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df6ff0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7cfe expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.544943:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105600/0xa6ea017771df6ff7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.544959:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105600/0xa6ea017771df6ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.544971:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105600/0xa6ea017771df6ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351246.544981:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789351246.545115:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df6ff0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cfe expref: 37 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.545153:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105600/0xa6ea017771df6ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cfe expref: 36 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.545162:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:3.0:1789351246.545165:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789351246.545168:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105600, rc 0) 00000100:00100000:3.0:1789351246.545223:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+36:10330:x1876270616965504:12345-192.168.201.52@tcp:101:cat.0 Request processed in 431us (1035us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789351246.547208:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:2.0:1789351246.551439:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351246.551524:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616965760 00000100:00100000:3.0:1789351246.551533:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616965760 00000100:00100000:3.0:1789351246.551587:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:3.0:1789351246.551594:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+36:10330:x1876270616965760:12345-192.168.201.52@tcp:35:cat.0 00000100:00100000:3.0:1789351246.551808:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+37:10330:x1876270616965760:12345-192.168.201.52@tcp:35:cat.0 Request processed in 213us (379us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789351246.551815:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:1.0:1789351246.557965:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351246.558080:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616965888 00000100:00100000:0.0:1789351246.558091:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616965888 00000100:00100000:0.0:1789351246.558191:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:0.0:1789351246.558203:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff971500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+37:2348:x1876270616965888:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351246.558218:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351246.558247:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105600/0xa6ea017771df6ff7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cfe expref: 37 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351246.558270:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:0.0:1789351246.558276:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351246.558353:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff971500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+36:2348:x1876270616965888:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 153us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351246.558423:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:0.0:1789351246.598546:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351246.598763:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616966144 00000100:00100000:3.0:1789351246.598773:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616966144 00000100:00100000:3.0:1789351246.598892:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:3.0:1789351246.598904:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+36:10336:x1876270616966144:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:3.0:1789351246.598930:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351246.598933:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789351246.598961:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df6f5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cd4 expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.598999:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:3.0:1789351246.599004:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351246.599018:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df7005 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d05 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.599111:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df700c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.599125:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df6fdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cf7 expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.599133:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df700c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.599164:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df6fdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cf7 expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.599177:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df6fdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cf7 expref: 36 pid: 5823 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351246.599193:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc2c6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876270626424448:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351246.599401:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cffa71f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789351246.603107:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc2c6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876270626424448:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351246.603137:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df700c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351246.603722:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351246.604107:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616966272 00000100:00100000:3.0:1789351246.604130:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616966272 00010000:00010000:3.0:1789351246.604166:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df6fdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cf7 expref: 37 pid: 5823 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351246.604214:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:3.0:1789351246.604225:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6583c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+37:2347:x1876270616966272:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351246.604240:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351246.604248:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df6fdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cf7 expref: 37 pid: 5823 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.604262:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df6fdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cf7 expref: 37 pid: 5823 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.604284:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df6fdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cf7 expref: 37 pid: 5823 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.604301:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:3.0:1789351246.604319:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df700c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.604329:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df700c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.604337:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df700c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.609164:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789351246.609332:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df700c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.609371:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df700c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351246.609395:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789351246.609563:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df7005 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d05 expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.609587:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df700c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d05 expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.609596:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:1.0:1789351246.609599:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789351246.609602:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104e00, rc 0) 00000100:00100000:3.0:1789351246.609675:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6583c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+37:2347:x1876270616966272:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 5449us (5952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351246.609701:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:1.0:1789351246.615026:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+36:10336:x1876270616966144:12345-192.168.201.52@tcp:101:dd.0 Request processed in 16112us (16477us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789351246.615040:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:2.0:1789351246.621958:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351246.622035:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616966528 00000100:00100000:1.0:1789351246.622045:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616966528 00000100:00100000:1.0:1789351246.622103:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:1.0:1789351246.622113:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+36:10336:x1876270616966528:12345-192.168.201.52@tcp:36:dd.0 00010000:00010000:1.0:1789351246.622633:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df701a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.622650:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df701a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.622663:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df701a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789351246.622726:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1789351246.622752:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c139230e reply state 0000000060490b52 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df701a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351246.622761:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789351246.622919:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+39:10336:x1876270616966528:12345-192.168.201.52@tcp:36:dd.0 Request processed in 805us (969us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789351246.622926:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000020:00080000:1.0:1789351246.622932:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789351246.625086:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df701a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.625101:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df701a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.625108:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df701a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.625114:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351246.625119:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df701a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.625126:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df701a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.625141:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:1.0:1789351246.625144:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351246.625149:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df701a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.625155:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df701a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351246.764413:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351246.764583:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351246.764683:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616966656 00000100:00100000:1.0:1789351246.764708:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616966656 00000100:00100000:1.0:1789351246.764770:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 258 00000100:00100000:1.0:1789351246.764781:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8338050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2347:x1876270616966656:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789351246.764874:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8338050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2347:x1876270616966656:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 95us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351246.764882:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 258 00000100:00100000:3.0:1789351246.766477:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616966784 00000100:00100000:3.0:1789351246.766490:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616966784 00000100:00100000:3.0:1789351246.766575:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:3.0:1789351246.766586:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2347:x1876270616966784:12345-192.168.201.52@tcp:400:kworker.0 00000100:00080000:0.0:1789351246.766753:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351246.766780:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2347:x1876270616966784:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 195us (2379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351246.766787:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:2.0:1789351246.813003:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351246.813100:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616966912 00000100:00100000:1.0:1789351246.813112:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616966912 00000100:00100000:1.0:1789351246.813177:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:1.0:1789351246.813188:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+38:10350:x1876270616966912:12345-192.168.201.52@tcp:101:stat.0 00010000:00010000:1.0:1789351246.813213:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351246.813234:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df7021 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d0c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.813300:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df7028 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.813328:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df7028 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.813339:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df7028 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.813354:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df702f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.813383:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df702f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.813406:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df702f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.814328:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7036 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.814346:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df700c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d05 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.814355:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7036 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.814415:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df700c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d05 expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.814430:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df700c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d05 expref: 39 pid: 5823 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351246.814445:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff972d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876270626424576:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789351246.815337:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf9d7d0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789351246.817530:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789351246.818592:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351246.818708:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff972d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876270626424576:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351246.818733:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7036 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351246.820498:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616967168 00000100:00100000:3.0:1789351246.820510:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616967168 00000100:00100000:3.0:1789351246.820590:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:3.0:1789351246.820602:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+40:5580:x1876270616967168:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789351246.821333:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+41:5580:x1876270616967168:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 732us (2746us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1789351246.821342:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:0.0:1789351246.823451:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351246.823546:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616967296 00000100:00100000:1.0:1789351246.823555:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616967296 00010000:00010000:1.0:1789351246.823594:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df700c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d05 expref: 41 pid: 5823 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351246.823687:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:1.0:1789351246.823698:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+41:2348:x1876270616967296:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351246.823713:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351246.823720:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df700c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d05 expref: 41 pid: 5823 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.823732:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df700c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d05 expref: 41 pid: 5823 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.823755:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df700c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d05 expref: 41 pid: 5823 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.823772:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:1.0:1789351246.823778:0:6676:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7036 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.823787:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.823795:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7036 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.823830:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351246.823882:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+40:2348:x1876270616967296:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 187us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351246.823890:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00010000:00010000:3.0:1789351246.824257:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824267:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351246.824323:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789351246.824328:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351246.824445:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824460:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824476:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df7028 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824482:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df7028 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824489:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df7028 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824496:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351246.824501:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df7028 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824508:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df7028 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824518:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:3.0:1789351246.824521:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351246.824526:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df7028 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824532:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df7028 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824543:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df702f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824550:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df702f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824556:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df702f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824567:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351246.824570:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df702f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824576:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df702f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824584:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2cc3d1c500) 00010000:00010000:3.0:1789351246.824587:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351246.824590:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df702f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824596:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df702f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824630:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df7021 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d0c expref: 40 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824643:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d0c expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351246.824651:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:3.0:1789351246.824653:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789351246.824655:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5e00, rc 0) 00000100:00100000:3.0:1789351246.824699:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+39:10350:x1876270616966912:12345-192.168.201.52@tcp:101:stat.0 Request processed in 11513us (12237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351246.824707:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:0.0:1789351246.889682:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351246.889784:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616967552 00000100:00100000:1.0:1789351246.889807:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616967552 00000100:00100000:1.0:1789351246.889875:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:1.0:1789351246.889885:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+39:10356:x1876270616967552:12345-192.168.201.52@tcp:36:truncate.0 00010000:00010000:1.0:1789351246.889939:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351246.889967:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7036 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d0c expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.889987:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:1.0:1789351246.889992:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789351246.890184:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df703d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.890198:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df703d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.890208:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df703d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789351246.890258:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1789351246.890282:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6dbdba7 reply state 000000000930fc0d transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df703d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351246.890291:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789351246.890468:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+41:10356:x1876270616967552:12345-192.168.201.52@tcp:36:truncate.0 Request processed in 584us (795us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789351246.890476:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00000020:00080000:1.0:1789351246.890482:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789351246.892749:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df703d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.892765:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df703d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.892787:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df703d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.892794:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351246.892799:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df703d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.892807:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df703d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.892836:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:1.0:1789351246.892839:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351246.892844:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df703d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351246.892850:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df703d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351247.007554:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351247.011573:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616967680 00000100:00100000:0.0:1789351247.011763:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616967680 00000100:00100000:0.0:1789351247.011858:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:0.0:1789351247.011874:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+40:10370:x1876270616967680:12345-192.168.201.52@tcp:101:stat.0 00010000:00010000:0.0:1789351247.011907:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351247.011933:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df7044 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d13 expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012026:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df704b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012044:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df704b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012059:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df704b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012078:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df7052 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012086:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df7052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012110:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df7052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012240:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df7059 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012249:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df7059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012257:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df7059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351247.012313:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789351247.012319:0:10562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789351247.012349:0:10562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df7059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012389:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df7059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012400:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df704b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012408:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df704b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012481:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df704b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012490:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351247.012495:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df704b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012511:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df704b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012526:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:0.0:1789351247.012530:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351247.012535:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df704b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012542:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df704b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012560:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df7052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012566:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df7052 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012572:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df7052 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012578:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351247.012581:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df7052 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012803:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df7052 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012812:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2cc886ee00) 00010000:00010000:0.0:1789351247.012816:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351247.012819:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df7052 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012835:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df7052 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012875:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df7044 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d13 expref: 42 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012889:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df7059 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d13 expref: 41 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.012896:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:0.0:1789351247.012899:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789351247.012902:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0031400, rc 0) 00000100:00100000:0.0:1789351247.013074:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+41:10370:x1876270616967680:12345-192.168.201.52@tcp:101:stat.0 Request processed in 1204us (5547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351247.013082:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:2.0:1789351247.087333:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.089651:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616967936 00000100:00100000:3.0:1789351247.089756:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616967936 00000100:00100000:3.0:1789351247.089898:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:3.0:1789351247.089911:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+41:10380:x1876270616967936:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351247.089938:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351247.089964:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7060 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d1a expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351247.090130:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1789351247.090292:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7060 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d1a expref: 43 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.090456:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a200) 00010000:00010000:3.0:1789351247.090459:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789351247.090466:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7060 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d1a expref: 43 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.090488:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105400, rc 0) 00000100:00100000:2.0:1789351247.090683:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+42:10380:x1876270616967936:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 772us (3364us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1789351247.090693:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:3.0:1789351247.095959:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351247.096078:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616968192 00000100:00100000:1.0:1789351247.096092:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616968192 00000100:00100000:1.0:1789351247.097204:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:1.0:1789351247.097223:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+42:10380:x1876270616968192:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789351247.097623:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+43:10380:x1876270616968192:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 406us (1676us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789351247.097633:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:0.0:1789351247.150016:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.150120:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616968448 00000100:00100000:3.0:1789351247.150135:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616968448 00000100:00100000:3.0:1789351247.150220:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:3.0:1789351247.150233:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+43:10386:x1876270616968448:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789351247.150265:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351247.150291:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df706e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d21 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.151042:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7075 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.151079:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df7059 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d13 expref: 44 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.151091:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7075 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.151140:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df7059 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d13 expref: 44 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.151158:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df7059 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d13 expref: 44 pid: 10562 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351247.151176:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc2c6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876270626424704:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351247.151399:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cffa71240 going to sleep for 11 seconds 00000100:00100000:2.0:1789351247.153888:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.154018:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc2c6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876270626424704:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351247.154054:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7075 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351247.154210:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616968576 00000100:00100000:1.0:1789351247.154219:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616968576 00010000:00010000:1.0:1789351247.154265:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df7059 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d13 expref: 45 pid: 10562 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351247.154337:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:1.0:1789351247.154349:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+45:2347:x1876270616968576:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351247.154414:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351247.154423:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df7059 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d13 expref: 45 pid: 10562 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.154438:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df7059 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d13 expref: 45 pid: 10562 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.154467:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df7059 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d13 expref: 45 pid: 10562 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.154486:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:1.0:1789351247.154492:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7075 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.154505:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7075 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.154513:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7075 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.154541:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351247.154606:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+44:2347:x1876270616968576:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 259us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351247.154614:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00010000:00010000:3.0:1789351247.154684:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7075 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.154705:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7075 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351247.154732:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1789351247.154943:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df706e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d21 expref: 45 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.154977:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7075 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d21 expref: 44 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.154985:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:3.0:1789351247.154988:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789351247.154991:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104600, rc 0) 00000100:00100000:3.0:1789351247.155024:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+44:10386:x1876270616968448:12345-192.168.201.52@tcp:101:bash.0 Request processed in 4794us (5021us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789351247.155031:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:0.0:1789351247.156986:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351247.157353:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616968832 00000100:00100000:1.0:1789351247.157458:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616968832 00000100:00100000:1.0:1789351247.157526:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:1.0:1789351247.157538:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+44:10386:x1876270616968832:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:1.0:1789351247.161125:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7083 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.161332:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.161349:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789351247.161783:0:10562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1789351247.161812:0:10562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000310c66ec reply state 0000000047dbd9b3 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351247.161824:0:10562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789351247.162165:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+47:10386:x1876270616968832:12345-192.168.201.52@tcp:36:bash.0 Request processed in 4613us (5179us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789351247.162176:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 57 00000020:00080000:1.0:1789351247.162186:0:10562:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789351247.166419:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.166444:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7083 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.166454:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7083 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.166462:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351247.166468:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7083 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.166499:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7083 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.166521:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:1.0:1789351247.166524:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351247.166530:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7083 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.166537:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7083 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351247.169058:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351247.169165:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616968960 00000100:00100000:2.0:1789351247.169178:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616968960 00000100:00100000:2.0:1789351247.169287:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:2.0:1789351247.169296:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+46:10386:x1876270616968960:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789351247.169612:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351247.169660:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df708a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d28 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.169774:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7091 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.169793:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7075 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d21 expref: 47 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.169803:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7091 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.169866:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7075 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d21 expref: 47 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.169884:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7075 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d21 expref: 47 pid: 5822 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351247.169902:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876270626424832:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351247.170076:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc604c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351247.172315:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.172406:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616969088 00000100:00100000:3.0:1789351247.172427:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616969088 00010000:00010000:3.0:1789351247.172481:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7075 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d21 expref: 48 pid: 5822 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351247.172521:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:3.0:1789351247.172534:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+48:2347:x1876270616969088:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351247.172565:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351247.172573:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7075 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d21 expref: 48 pid: 5822 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.172589:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7075 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d21 expref: 48 pid: 5822 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.172617:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:3.0:1789351247.172639:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7091 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.172650:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.172657:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7091 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.172680:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351247.172743:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+48:2347:x1876270616969088:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 212us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351247.172751:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00010000:00010000:1.0:1789351247.173177:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7075 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d21 expref: 47 pid: 5822 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351247.173200:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876270626424832:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351247.173230:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.173240:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.173246:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351247.173321:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789351247.173327:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789351247.173354:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.173408:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df708a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d28 expref: 47 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.173437:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7091 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d28 expref: 46 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.173445:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:1.0:1789351247.173449:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789351247.173451:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1e00, rc 0) 00000100:00100000:1.0:1789351247.173495:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+46:10386:x1876270616968960:12345-192.168.201.52@tcp:101:bash.0 Request processed in 4200us (4452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351247.173502:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:3.0:1789351247.176145:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351247.177777:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616969344 00000100:00100000:2.0:1789351247.177797:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616969344 00000100:00100000:2.0:1789351247.177922:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:2.0:1789351247.177937:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf03a1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+46:10386:x1876270616969344:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:2.0:1789351247.178270:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf03a1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+47:10386:x1876270616969344:12345-192.168.201.52@tcp:35:bash.0 Request processed in 335us (2142us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789351247.178279:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:3.0:1789351247.229568:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351247.229707:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616969600 00000100:00100000:1.0:1789351247.229720:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616969600 00000100:00100000:1.0:1789351247.229792:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:1.0:1789351247.229802:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+47:10396:x1876270616969600:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789351247.229836:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351247.229864:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7098 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d2f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351247.230015:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1789351247.230135:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7098 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d2f expref: 49 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.230149:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a200) 00010000:00010000:1.0:1789351247.230152:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789351247.230156:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7098 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d2f expref: 49 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.230186:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4600, rc 0) 00000100:00100000:1.0:1789351247.230252:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+48:10396:x1876270616969600:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 451us (703us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1789351247.230258:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:0.0:1789351247.232212:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351247.232258:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616969728 00000100:00100000:1.0:1789351247.232269:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616969728 00000100:00100000:1.0:1789351247.232330:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:1.0:1789351247.232525:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+48:10396:x1876270616969728:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:1.0:1789351247.232659:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df70a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.232676:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df70a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.232687:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df70a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.232703:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df70ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.232708:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df70ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.232714:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df70ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.232834:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df70b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.232862:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df70b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.232868:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df70b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789351247.232918:0:10562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df70b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.232932:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df70a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.232940:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df70a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.232947:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df70a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.232952:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351247.232956:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df70a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.232963:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df70a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.232973:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:1.0:1789351247.232975:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351247.232978:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df70a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.232983:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df70a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.233000:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df70ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.233005:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df70ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.233009:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df70ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.233011:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351247.233013:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df70ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.233016:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df70ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.233020:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2cc3d1c300) 00010000:00010000:1.0:1789351247.233022:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351247.233023:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df70ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.233026:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df70ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.233037:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df70b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.233040:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df70b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.233044:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df70b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.233051:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351247.233053:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df70b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.233056:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df70b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.233060:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:1.0:1789351247.233061:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351247.233063:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df70b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.233066:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df70b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351247.233136:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+48:10396:x1876270616969728:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 619us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351247.233141:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:0.0:1789351247.234631:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351247.234881:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616969984 00000100:00100000:1.0:1789351247.234896:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616969984 00000100:00100000:0.0:1789351247.234999:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:0.0:1789351247.235010:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+48:10396:x1876270616969984:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1789351247.235293:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+49:10396:x1876270616969984:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 285us (669us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789351247.235309:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:2.0:1789351247.265745:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351247.266044:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616970240 00000100:00100000:1.0:1789351247.266059:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616970240 00000100:00100000:3.0:1789351247.266232:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:3.0:1789351247.266251:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+49:10399:x1876270616970240:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351247.266288:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351247.266328:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df70bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266487:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df70c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266506:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df70c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266522:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df70c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266537:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df70c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266558:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df70c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266563:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df70c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266736:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df70d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266744:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df70d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266749:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df70d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351247.266757:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789351247.266863:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df70c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266868:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df70c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266873:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df70c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266878:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351247.266881:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df70c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266886:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df70c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266907:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:3.0:1789351247.266909:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351247.266914:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df70c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266918:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df70c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266930:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df70c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266933:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df70c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266936:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df70c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266940:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351247.266942:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df70c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266946:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df70c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266949:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2ce058f400) 00010000:00010000:3.0:1789351247.266951:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351247.266952:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df70c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.266955:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df70c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.267021:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df70bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d36 expref: 52 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.267038:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df70d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d36 expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.267046:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:3.0:1789351247.267048:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789351247.267050:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105e00, rc 0) 00000100:00100000:3.0:1789351247.267127:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+51:10399:x1876270616970240:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 882us (1397us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789351247.267135:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:1.0:1789351247.272630:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.272732:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616970368 00000100:00100000:3.0:1789351247.272745:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616970368 00000100:00100000:1.0:1789351247.272863:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.272895:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:3.0:1789351247.272909:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff972d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+51:2347:x1876270616970368:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351247.272931:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789351247.272948:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616970496 00000100:00100000:0.0:1789351247.272952:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616970496 00010000:00010000:3.0:1789351247.272964:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df70d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d36 expref: 52 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351247.272993:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:0.0:1789351247.273001:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+52:10399:x1876270616970496:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:3.0:1789351247.273090:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:3.0:1789351247.273097:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789351247.273123:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df70de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.273139:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df70de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.273150:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df70de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351247.273168:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff972d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+51:2347:x1876270616970368:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 263us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351247.273176:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00010000:00010000:0.0:1789351247.273185:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df70de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.273192:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df70de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.273198:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df70de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.273205:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351247.273210:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df70de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.273218:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df70de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.273781:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:0.0:1789351247.273783:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789351247.273787:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df70de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.273797:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df70de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351247.273845:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+50:10399:x1876270616970496:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 844us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351247.273852:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:1.0:1789351247.277342:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351247.277781:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616970752 00000100:00100000:0.0:1789351247.277798:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616970752 00000100:00100000:0.0:1789351247.277920:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:0.0:1789351247.277932:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+50:10399:x1876270616970752:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1789351247.278318:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+51:10399:x1876270616970752:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 386us (989us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789351247.278328:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:3.0:1789351247.384564:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351247.384769:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616971008 00000100:00100000:1.0:1789351247.384782:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616971008 00000100:00100000:1.0:1789351247.384856:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:1.0:1789351247.384866:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+51:10417:x1876270616971008:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:1.0:1789351247.384913:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351247.384937:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df70e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d3d expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.385067:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df70ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.385085:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df70ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.385101:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df70ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351247.385116:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789351247.386005:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df70e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d3d expref: 54 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.386034:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df70ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d3d expref: 53 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.386044:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:1.0:1789351247.386048:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789351247.386052:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4800, rc 0) 00000100:00100000:1.0:1789351247.386134:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+53:10417:x1876270616971008:12345-192.168.201.52@tcp:101:cat.0 Request processed in 1268us (1592us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789351247.386143:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:1.0:1789351247.403038:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.403135:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616971136 00000100:00100000:3.0:1789351247.403155:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616971136 00000100:00100000:3.0:1789351247.403239:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:3.0:1789351247.403251:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+53:10418:x1876270616971136:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351247.403290:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351247.403326:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df70fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d44 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.403761:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7101 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.403782:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.403800:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351247.403888:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1789351247.403893:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351247.403922:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.403955:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df70fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d44 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.403981:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d44 expref: 54 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.403991:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:3.0:1789351247.404013:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789351247.404020:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104c00, rc 0) 00000100:00100000:3.0:1789351247.404113:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+54:10418:x1876270616971136:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 864us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351247.404121:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:0.0:1789351247.409145:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351247.409274:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616971520 00000100:00100000:2.0:1789351247.409289:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616971520 00000100:00100000:2.0:1789351247.409665:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:2.0:1789351247.409678:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+54:10418:x1876270616971520:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1789351247.410121:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+55:10418:x1876270616971520:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 445us (990us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789351247.410130:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:0.0:1789351247.417622:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.417688:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616971648 00000100:00100000:3.0:1789351247.417702:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616971648 00000100:00100000:3.0:1789351247.417786:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:3.0:1789351247.417797:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+55:10418:x1876270616971648:12345-192.168.201.52@tcp:103:lfs.0 00010000:00010000:3.0:1789351247.417815:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789351247.417847:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7091 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d28 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.417873:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df70ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d3d expref: 54 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.417886:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df6f9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ce9 expref: 53 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.417899:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:3.0:1789351247.417910:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351247.417975:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+52:10418:x1876270616971648:12345-192.168.201.52@tcp:103:lfs.0 Request processed in 180us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351247.417983:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:1.0:1789351247.420740:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351247.421406:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616971776 00000100:00100000:0.0:1789351247.421536:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616971776 00000100:00100000:0.0:1789351247.421828:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:0.0:1789351247.421843:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+52:10418:x1876270616971776:12345-192.168.201.52@tcp:58:lfs.0 00010000:00010000:0.0:1789351247.422046:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7108 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.422068:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7108 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.422082:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7108 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789351247.422998:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789351247.423249:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789351247.423337:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789351247.424685:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+52:10418:x1876270616971776:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 2831us (3946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351247.424701:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:0.0:1789351247.444854:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351247.445249:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616971904 00000100:00100000:1.0:1789351247.445291:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616971904 00000100:00100000:3.0:1789351247.445439:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:3.0:1789351247.445457:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+52:10420:x1876270616971904:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351247.445495:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351247.445966:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df710f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d4b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446067:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7116 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446085:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7116 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446101:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7116 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446119:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df711d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446128:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df711d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446134:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df711d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446328:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7124 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446353:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446395:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351247.446633:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789351247.446640:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351247.446785:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446801:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446811:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7116 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446819:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7116 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446826:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7116 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446833:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351247.446838:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7116 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446848:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7116 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446865:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:2.0:1789351247.446870:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351247.446886:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7116 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446893:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7116 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446910:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df711d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446915:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df711d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446921:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df711d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446926:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351247.446929:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df711d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446935:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df711d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446943:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2ce9e1ab00) 00010000:00010000:2.0:1789351247.446945:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351247.446948:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df711d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.446954:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df711d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.447006:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df710f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d4b expref: 54 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.447037:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d4b expref: 53 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.447046:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2cc886ee00) 00010000:00010000:2.0:1789351247.447048:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789351247.447051:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1000, rc 0) 00000100:00100000:2.0:1789351247.447280:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+53:10420:x1876270616971904:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1818us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351247.447631:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 66 00000040:00080000:3.0:1789351247.587914:0:11642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789351247.587928:0:11642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789351247.587994:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789351247.588003:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789351247.588184:0:11642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc2c6e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11642:1876270626424960:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789351247.588414:0:11642:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cffa71900 going to sleep for 11 seconds 00000100:00100000:3.0:1789351247.596849:0:11642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc2c6e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11642:1876270626424960:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789351247.604531:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351247.604835:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616972032 00000100:00100000:1.0:1789351247.604848:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616972032 00000100:00100000:1.0:1789351247.604918:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:1.0:1789351247.604931:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8237986d-b9e8-417a-ac8f-a078390d268c+53:10431:x1876270616972032:12345-192.168.201.52@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789351247.605048:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8237986d-b9e8-417a-ac8f-a078390d268c+53:10431:x1876270616972032:12345-192.168.201.52@tcp:900:lhsmtool_posix.0 Request processed in 118us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351247.605057:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:2.0:1789351247.607236:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.607300:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616972160 00000100:00100000:3.0:1789351247.607311:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616972160 00000100:00100000:3.0:1789351247.607419:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:3.0:1789351247.607439:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+53:10431:x1876270616972160:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789351247.607480:0:9467:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789351247.607656:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+53:10431:x1876270616972160:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 220us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351247.607665:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:0.0:1789351247.615223:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.615339:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616972288 00000100:00100000:3.0:1789351247.615354:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616972288 00000100:00100000:3.0:1789351247.615745:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:3.0:1789351247.615759:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+53:10431:x1876270616972288:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789351247.615879:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df712b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.615902:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df712b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.615920:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df712b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.615946:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7132 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.615953:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7132 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.615960:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7132 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.615998:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7139 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616007:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616014:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351247.616067:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789351247.616073:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351247.616088:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616103:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df712b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616109:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df712b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616116:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df712b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616132:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351247.616137:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df712b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616146:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df712b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616162:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2cc3d1c800) 00010000:00010000:3.0:1789351247.616165:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351247.616172:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df712b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616179:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df712b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616191:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7132 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616198:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7132 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616203:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7132 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616208:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351247.616211:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7132 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616217:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7132 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616234:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8d2ce058f600) 00010000:00010000:3.0:1789351247.616237:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351247.616241:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7132 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616247:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7132 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616263:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616269:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7139 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616275:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616280:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351247.616284:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616290:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7139 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616312:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2cc886ee00) 00010000:00010000:3.0:1789351247.616314:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351247.616317:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7139 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.616322:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7139 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351247.616947:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+53:10431:x1876270616972288:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 1184us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351247.616959:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:2.0:1789351247.619151:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.619251:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616972544 00000100:00100000:3.0:1789351247.619264:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616972544 00000100:00100000:3.0:1789351247.619382:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:3.0:1789351247.619404:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+53:10431:x1876270616972544:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351247.619429:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351247.619452:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7140 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.619585:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7147 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.619602:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.619615:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351247.619629:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789351247.619760:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.619769:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7147 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.619776:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7147 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.619799:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351247.619804:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7147 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.619812:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7147 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.619827:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2cc886ee00) 00010000:00010000:3.0:1789351247.619831:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789351247.619836:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7147 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.619843:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7147 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.619897:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7140 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d52 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.619909:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2cc3d1c800) 00010000:00010000:3.0:1789351247.619911:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789351247.619914:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7140 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d52 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.619924:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104a00, rc 0) 00000100:00100000:3.0:1789351247.620002:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+54:10431:x1876270616972544:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 601us (862us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1789351247.620010:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:2.0:1789351247.626443:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.626626:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616972672 00000100:00100000:3.0:1789351247.626654:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616972672 00000100:00100000:3.0:1789351247.626741:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:3.0:1789351247.626753:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+54:10431:x1876270616972672:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789351247.626795:0:9467:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789351247.626916:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+54:10431:x1876270616972672:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 165us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351247.626925:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:0.0:1789351247.629973:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.630063:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616972928 00000100:00100000:3.0:1789351247.630077:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616972928 00000100:00100000:3.0:1789351247.630144:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:3.0:1789351247.630156:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+54:10431:x1876270616972928:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351247.630182:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351247.630186:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789351247.630219:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7101 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d44 expref: 54 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.630242:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:3.0:1789351247.630247:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351247.630265:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7155 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d59 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789351247.630951:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789351247.631324:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df715c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.631338:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df715c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.631379:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df715c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.631492:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7155 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d59 expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.631507:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df715c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d59 expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.631513:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2ce058f600) 00010000:00010000:3.0:1789351247.631516:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789351247.631518:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105800, rc 0) 00000100:00100000:3.0:1789351247.631600:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+55:10431:x1876270616972928:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1446us (1643us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789351247.631609:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:2.0:1789351247.634859:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.634940:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616973184 00000100:00100000:3.0:1789351247.634951:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616973184 00000100:00100000:3.0:1789351247.635122:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:3.0:1789351247.635135:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+55:10431:x1876270616973184:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789351247.635207:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351247.635241:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df715c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d59 expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.635265:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2ce058f600) 00010000:00010000:3.0:1789351247.635278:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351247.636517:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df716a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.636563:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df716a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.636576:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df716a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639475:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7171 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x16834414 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639500:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x16834414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639514:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x16834414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639613:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df716a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639621:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df716a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639629:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df716a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639634:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351247.639639:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df716a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639646:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df716a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639660:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:3.0:1789351247.639677:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351247.639682:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df716a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639689:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df716a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639707:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x16834414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639713:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7171 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x16834414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639719:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7171 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x16834414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639724:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351247.639727:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7171 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x16834414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639733:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7171 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x16834414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639741:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x16834414 (ffff8d2ce058f100) 00010000:00010000:3.0:1789351247.639743:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351247.639747:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7171 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x16834414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.639753:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7171 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x16834414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351247.640022:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+54:10431:x1876270616973184:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 4883us (5167us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789351247.640040:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:2.0:1789351247.641756:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351247.641833:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616973312 00000100:00100000:0.0:1789351247.641850:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616973312 00000100:00100000:0.0:1789351247.641935:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 73 00000100:00100000:0.0:1789351247.641950:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+54:10431:x1876270616973312:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789351247.641989:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351247.642027:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df7178 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d60 expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.642092:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df717f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.642109:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df717f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.642122:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df717f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.642261:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df7178 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d60 expref: 56 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.642307:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df717f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d60 expref: 55 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.642317:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2cc886ea00) 00010000:00010000:0.0:1789351247.642320:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789351247.642324:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0030800, rc 0) 00000100:00100000:0.0:1789351247.642466:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+55:10431:x1876270616973312:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 518us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351247.642474:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 73 00000100:00100000:0.0:1789351247.644664:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.644727:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616973568 00000100:00100000:3.0:1789351247.644741:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616973568 00000100:00100000:3.0:1789351247.644812:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:3.0:1789351247.644824:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+55:10431:x1876270616973568:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789351247.644903:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7186 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.644919:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.644929:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789351247.645177:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1789351247.645186:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 192090827209ns, next at 193090825407ns, rc = 0 00000004:00010000:3.0:1789351247.645257:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c7aad9d reply state 000000009708d421 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351247.645265:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789351247.645403:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+57:10431:x1876270616973568:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 581us (752us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1789351247.645410:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 74 00010000:00010000:1.0:1789351247.647656:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.647678:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7186 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.647688:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7186 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.647695:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351247.647701:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7186 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.647711:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7186 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.647731:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2cc886ea00) 00010000:00010000:1.0:1789351247.647735:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789351247.647742:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7186 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.647749:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7186 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351247.651239:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.651478:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616973696 00000100:00100000:3.0:1789351247.651491:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616973696 00000100:00100000:3.0:1789351247.651565:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00100000:3.0:1789351247.651574:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+56:10431:x1876270616973696:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351247.651604:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351247.651641:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df718d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d67 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.651709:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df718d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d67 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.651726:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df718d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d67 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.651749:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2cc886ea00) 00010000:00010000:3.0:1789351247.651753:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789351247.651758:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105e00, rc 0) 00000100:00100000:3.0:1789351247.651829:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+57:10431:x1876270616973696:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 255us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351247.651837:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00100000:2.0:1789351247.654924:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351247.655568:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616973824 00000100:00100000:0.0:1789351247.655582:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616973824 00000100:00100000:0.0:1789351247.655635:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:0.0:1789351247.655645:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2346:x1876270616973824:12345-192.168.201.52@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1789351247.655686:0:11341:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1789351247.655718:0:11341:0:(genops.c:1406:class_connect()) connect: client 8237986d-b9e8-417a-ac8f-a078390d268c, cookie 0xa6ea017771df7194 00002000:00100000:0.0:1789351247.655731:0:11341:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8237986d-b9e8-417a-ac8f-a078390d268c/ffff8d2cc6fd3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789351247.655756:0:11341:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789351247.656011:0:11341:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789351247.656047:0:11341:0:(import.c:65:import_set_state_nolock()) ffff8d2cc6fd6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789351247.656126:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+6:2346:x1876270616973824:12345-192.168.201.52@tcp:8:lhsmtool_posix.0 Request processed in 481us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351247.656134:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:1.0:1789351247.657650:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.657745:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616973952 00000100:00100000:3.0:1789351247.657754:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616973952 00000100:00080000:0.0:1789351247.657813:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789351247.657825:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:3.0:1789351247.657839:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+6:0:x1876270616973952:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000001:00100000:3.0:1789351247.708197:0:7616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8237986d-b9e8-417a-ac8f-a078390d268c 00000001:00080000:3.0:1789351247.708226:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1789351247.708390:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:0:x1876270616973952:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 50524us (50716us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789351247.708405:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:0.0:1789351247.712899:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351247.713956:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616974208 00000100:00100000:2.0:1789351247.713976:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616974208 00000100:00100000:2.0:1789351247.714052:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:2.0:1789351247.714064:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+57:10431:x1876270616974208:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789351247.714433:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+58:10431:x1876270616974208:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 370us (1548us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789351247.714442:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:2.0:1789351247.718305:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351247.718417:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616974464 00000100:00100000:0.0:1789351247.718431:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616974464 00000100:00100000:0.0:1789351247.718508:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:0.0:1789351247.718520:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+58:10431:x1876270616974464:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789351247.718677:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+58:10431:x1876270616974464:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 158us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351247.718686:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:1.0:1789351247.724066:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.724159:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616974592 00000100:00100000:3.0:1789351247.724182:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616974592 00000100:00100000:3.0:1789351247.724262:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 77 00000100:00100000:3.0:1789351247.724275:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+58:10431:x1876270616974592:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351247.724311:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351247.724338:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df719b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d6e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.724483:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df71a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.724502:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df71a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.724517:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df71a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351247.724574:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351247.724599:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df71a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.724633:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df719b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d6e expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.724653:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df71a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d6e expref: 59 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.724660:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2cc886ea00) 00010000:00010000:3.0:1789351247.724663:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789351247.724665:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105800, rc 0) 00000100:00100000:3.0:1789351247.724760:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+59:10431:x1876270616974592:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 486us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351247.724767:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 77 00000100:00100000:3.0:1789351247.730760:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351247.730982:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616974720 00000100:00100000:2.0:1789351247.730996:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616974720 00000100:00100000:2.0:1789351247.731448:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:2.0:1789351247.731461:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+5:2350:x1876270616974720:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789351247.731487:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351247.731516:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad757535/0xa6ea017771df71a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d75 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789351247.731620:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa7554f, blocks: 0x1 00010000:00010000:2.0:1789351247.731652:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=192s v=(0 0) 00010000:00010000:2.0:1789351247.731658:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351247.731671:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad757535/0xa6ea017771df71a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d75 expref: 6 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.731697:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ad757535/0xa6ea017771df71a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d75 expref: 6 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.731716:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1200, rc 0) 00000100:00100000:2.0:1789351247.731796:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+6:2350:x1876270616974720:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 337us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351247.731803:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:3.0:1789351247.734568:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351247.734636:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616974976 00000100:00100000:1.0:1789351247.734651:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616974976 00000100:00100000:1.0:1789351247.734729:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:1.0:1789351247.734744:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+59:10431:x1876270616974976:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789351247.734890:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+59:10431:x1876270616974976:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 150us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351247.734900:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:1.0:1789351247.738128:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351247.738198:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616975104 00000100:00100000:2.0:1789351247.738215:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616975104 00000100:00100000:2.0:1789351247.738286:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:2.0:1789351247.738309:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:10431:x1876270616975104:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789351247.738336:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351247.738398:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d53b5bc6/0xa6ea017771df71b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d7c expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.738475:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad757535/0xa6ea017771df71a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d75 expref: 7 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.738487:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351247.738492:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351247.738498:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d53b5bc6/0xa6ea017771df71b0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d7c expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.738545:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad757535/0xa6ea017771df71a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d75 expref: 7 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.738560:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad757535/0xa6ea017771df71a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d75 expref: 7 pid: 6660 timeout: 292 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351247.738579:0:6661:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6661:1876270626425088:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351247.738717:0:6661:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc55e2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789351247.742573:0:6661:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6661:1876270626425088:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351247.742636:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d53b5bc6/0xa6ea017771df71b0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d7c expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.742665:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0400, rc 0) 00000100:00100000:3.0:1789351247.742777:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+7:10431:x1876270616975104:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 4470us (4660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351247.742788:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:1.0:1789351247.744783:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351247.744838:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616975232 00000100:00100000:0.0:1789351247.744852:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616975232 00010000:00010000:0.0:1789351247.744917:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad757535/0xa6ea017771df71a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d75 expref: 7 pid: 6660 timeout: 292 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351247.744958:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:0.0:1789351247.744971:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270616975232:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351247.744991:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351247.745037:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad757535/0xa6ea017771df71a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d75 expref: 7 pid: 6660 timeout: 292 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.745054:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad757535/0xa6ea017771df71a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d75 expref: 7 pid: 6660 timeout: 292 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.745087:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad757535/0xa6ea017771df71a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d75 expref: 7 pid: 6660 timeout: 292 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.745121:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351247.745126:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351247.745138:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d53b5bc6/0xa6ea017771df71b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d7c expref: 6 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.745150:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d53b5bc6/0xa6ea017771df71b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d7c expref: 6 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.745200:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d53b5bc6/0xa6ea017771df71b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d7c expref: 6 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351247.745219:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5807:1876270626425216:192.168.201.52@tcp:105: 00000100:00100000:0.0:1789351247.745336:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc604c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351247.748328:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351247.748408:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616975360 00000100:00100000:1.0:1789351247.748425:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616975360 00002000:00100000:1.0:1789351247.748484:0:6668:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d2cc2c6fb80 x1876270616975360/t0(0) o4->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:503/0 lens 504/0 e 0 to 0 dl 1789351258 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789351247.748497:0:6668:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cc2c6fb80 with x1876270616975360 ext(0->8) 00002000:00010000:1.0:1789351247.748505:0:6668:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2cc2c6fb80 00000100:00100000:1.0:1789351247.748542:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:1.0:1789351247.748554:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8237986d-b9e8-417a-ac8f-a078390d268c+7:2348:x1876270616975360:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789351247.752684:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5807:1876270626425216:192.168.201.52@tcp:105: 00010000:00010000:0.0:1789351247.752716:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351247.752808:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270616975232:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 7841us (8036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351247.752820:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:1.0:1789351247.754114:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8237986d-b9e8-417a-ac8f-a078390d268c+8:2348:x1876270616975360:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 Request processed in 5553us (5791us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789351247.754137:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00002000:00100000:1.0:1789351247.754149:0:6668:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d2cc2c6fb80 x1876270616975360/t4294967302(0) o4->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:503/0 lens 504/448 e 0 to 0 dl 1789351258 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789351247.754159:0:6668:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cc2c6fb80 with x1876270616975360 ext(0->8) 00002000:00010000:1.0:1789351247.754165:0:6668:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2cc2c6fb80 00000100:00100000:3.0:1789351247.755312:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351247.755675:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616975488 00000100:00100000:0.0:1789351247.755687:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616975488 00000100:00100000:0.0:1789351247.755793:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00100000:0.0:1789351247.755807:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+59:10431:x1876270616975488:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789351247.804944:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+59:10431:x1876270616975488:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 49124us (49622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351247.804966:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 79 00000001:00080000:0.0:1789351247.805017:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000001:00080000:0.0:1789351247.805031:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:0.0:1789351247.805069:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1789351247.805081:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1789351247.805103:0:5844:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2cc65cee40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789351247.805107:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d2ce9d9dc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2cc65ce0c0 00000020:00080000:0.0:1789351247.805109:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d2ce9d9d900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2cf7592400 00000004:00080000:0.0:1789351247.805129:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:0.0:1789351247.805500:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626425344:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789351247.805576:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351247.805622:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626425344 00000100:00100000:1.0:1789351247.805632:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626425344 00000100:00100000:1.0:1789351247.805681:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789351247.805692:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3287:x1876270626425344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789351247.805724:0:11341:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00000020:00080000:3.0:1789351247.805768:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00002000:00010000:1.0:1789351247.805768:0:11341:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa7554e, atime: 0x6aa7554e, ctime: 0x6aa7554e, blocks: 0xb 00010000:00010000:1.0:1789351247.805778:0:11341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b15026e4/0xa6ea017771df71b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.805799:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=192s v=(0 0) 00010000:00010000:1.0:1789351247.805804:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789351247.805811:0:11341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b15026e4/0xa6ea017771df71b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.805829:0:11341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b15026e4/0xa6ea017771df71b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.805852:0:11341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b15026e4/0xa6ea017771df71b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.805874:0:11341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b15026e4/0xa6ea017771df71b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.805901:0:11341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1789351247.806026:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:0.0:1789351247.806074:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789351247.806083:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b15026e4/0xa6ea017771df71b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.806093:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5400 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351247.806098:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b15026e4/0xa6ea017771df71b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.806107:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b15026e4/0xa6ea017771df71b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.806129:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b15026e4/0xa6ea017771df71b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.806146:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b15026e4/0xa6ea017771df71b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.806164:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351247.806167:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351247.806169:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351247.806545:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3287:x1876270626425344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 851us (965us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789351247.806554:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:0.0:1789351247.806789:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2cc31d3100/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789351247.806797:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626425344:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789351247.807176:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351247.807222:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616975616 00000100:00100000:1.0:1789351247.807230:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616975616 00000100:00100000:1.0:1789351247.807326:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:1.0:1789351247.807337:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+8:2348:x1876270616975616:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789351247.807349:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789351247.807386:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626425472:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789351247.807441:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351247.807459:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626425472 00000100:00100000:0.0:1789351247.807463:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626425472 00000100:00100000:0.0:1789351247.807500:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789351247.807507:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626425472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789351247.807725:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789351247.807729:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789351247 00002000:00010000:0.0:1789351247.807731:0:6661:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789351247.807733:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789351247 -> 1789351247 00002000:00010000:0.0:1789351247.807735:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789351247.807781:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1876270626425472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 274us (339us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789351247.807788:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:2.0:1789351247.807832:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2cf9d44e00/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789351247.807840:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626425472:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789351247.843610:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351247.856966:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+8:2348:x1876270616975616:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 49614us (49777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351247.856981:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000001:00080000:3.0:1789351247.857162:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1789351247.859481:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351247.859551:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616975872 00000100:00100000:0.0:1789351247.859566:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616975872 00000100:00100000:0.0:1789351247.859650:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:0.0:1789351247.859662:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+13:10431:x1876270616975872:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789351247.859737:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351247.859780:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df71a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d6e expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.859810:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2cc886ea00) 00010000:00010000:0.0:1789351247.859816:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789351247.859863:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df71be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.859879:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df71be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.859890:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df71be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789351247.860243:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a09e2e1 reply state 00000000752b6ef6 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df71be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351247.860254:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789351247.860424:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+14:10431:x1876270616975872:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 763us (955us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789351247.860433:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 80 00010000:00010000:1.0:1789351247.864613:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df71be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.864643:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df71be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.864653:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df71be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.864661:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351247.864668:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df71be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351247.864681:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:1.0:1789351247.864688:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df71be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.864711:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2cc886ea00) 00010000:00010000:1.0:1789351247.864714:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351247.864721:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df71be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.864728:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df71be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351247.864845:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616976000 00000100:00100000:2.0:1789351247.864858:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616976000 00000100:00100000:2.0:1789351247.864947:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:2.0:1789351247.864961:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:2348:x1876270616976000:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789351247.865239:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789351247.865251:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789351247 -> 1789351247 00002000:00010000:2.0:1789351247.865254:0:6661:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789351246 00002000:00010000:2.0:1789351247.865257:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789351247 -> 1789351247 00002000:00010000:2.0:1789351247.865260:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789351247.865384:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+7:2348:x1876270616976000:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 424us (709us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789351247.865393:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:3.0:1789351247.871773:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351247.872029:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616976256 00000100:00100000:0.0:1789351247.872043:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616976256 00000100:00100000:0.0:1789351247.872147:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:0.0:1789351247.872160:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+13:10431:x1876270616976256:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789351247.872262:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.872283:0:9467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df717f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d60 expref: 13 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.872313:0:9467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71c5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.872377:0:9467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df717f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d60 expref: 13 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.872394:0:9467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df717f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d60 expref: 13 pid: 10562 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351247.872413:0:9467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9467:1876270626425600:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789351247.872541:0:9467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ceeca1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789351247.883707:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351247.883772:0:9467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9467:1876270626425600:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789351247.883808:0:9467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351247.883889:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616976384 00000100:00100000:2.0:1789351247.883898:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616976384 00010000:00010000:2.0:1789351247.883946:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df717f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d60 expref: 14 pid: 10562 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351247.884044:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:2.0:1789351247.884057:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6580850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+14:2348:x1876270616976384:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789351247.884077:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351247.884084:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df717f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d60 expref: 14 pid: 10562 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.884099:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df717f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d60 expref: 14 pid: 10562 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.884129:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df717f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d60 expref: 14 pid: 10562 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.884154:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2cc886ea00) 00010000:00010000:2.0:1789351247.884161:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.884186:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.884193:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71c5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.884218:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789351247.884275:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6580850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+13:2348:x1876270616976384:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 220us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351247.884283:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00010000:00010000:3.0:1789351247.886665:0:9467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.886688:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.886730:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.886738:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.886758:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.886766:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351247.886772:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.886781:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.886803:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2cc886ea00) 00010000:00010000:3.0:1789351247.886808:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789351247.886812:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.886819:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351247.886937:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+12:10431:x1876270616976256:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 Request processed in 14772us (15172us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789351247.886951:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:1.0:1789351247.893680:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.893728:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616976512 00000100:00100000:3.0:1789351247.893742:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616976512 00000100:00100000:3.0:1789351247.893921:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:3.0:1789351247.893934:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+7:2348:x1876270616976512:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789351247.893997:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df71cc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.894024:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d53b5bc6/0xa6ea017771df71b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d7c expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.894041:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351247.894046:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789351247.894052:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df71cc lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.894097:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d53b5bc6/0xa6ea017771df71b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d7c expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.894114:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d53b5bc6/0xa6ea017771df71b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d7c expref: 7 pid: 6661 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351247.894132:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc2c6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6660:1876270626425728:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351247.894252:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6e13000 going to sleep for 11 seconds 00000100:00100000:3.0:1789351247.899946:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc2c6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6660:1876270626425728:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351247.899992:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df71cc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351247.902857:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.902911:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616976640 00000100:00100000:3.0:1789351247.902928:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616976640 00010000:00010000:3.0:1789351247.902984:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d53b5bc6/0xa6ea017771df71b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d7c expref: 8 pid: 6661 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351247.903023:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:3.0:1789351247.903034:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+8:2347:x1876270616976640:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351247.903060:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351247.903090:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d53b5bc6/0xa6ea017771df71b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d7c expref: 8 pid: 6661 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.903107:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d53b5bc6/0xa6ea017771df71b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d7c expref: 8 pid: 6661 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.903139:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d53b5bc6/0xa6ea017771df71b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d7c expref: 8 pid: 6661 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.903155:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789351247.903159:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789351247.903165:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df71cc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.903177:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df71cc lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.903209:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351247.903273:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270616976640:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 240us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351247.903281:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00010000:00010000:3.0:1789351247.903442:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df71cc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.903453:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df71cc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.903531:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df71cc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.903542:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df71cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.903550:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df71cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.903559:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351247.903564:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df71cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.903573:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df71cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.903587:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df71cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.903594:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df71cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351247.903662:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+6:2348:x1876270616976512:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 9730us (9990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351247.903671:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:1.0:1789351247.905585:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.905676:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616976896 00000100:00100000:3.0:1789351247.905688:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616976896 00000100:00100000:3.0:1789351247.905779:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:3.0:1789351247.905806:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+12:10431:x1876270616976896:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789351247.905907:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df71d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.905927:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df71d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.905939:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df71d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.906201:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df71da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.906213:0:10562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df718d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d67 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.906222:0:10562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df71da lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.906264:0:10562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df718d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d67 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.906278:0:10562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df718d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d67 expref: 13 pid: 5822 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351247.906305:0:10562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc2c6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10562:1876270626425856:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351247.906473:0:10562:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6e13000 going to sleep for 11 seconds 00000100:00100000:0.0:1789351247.908829:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351247.910851:0:10562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc2c6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10562:1876270626425856:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351247.910894:0:10562:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df71da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351247.911931:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616977024 00000100:00100000:1.0:1789351247.911948:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616977024 00010000:00010000:1.0:1789351247.912006:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df718d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d67 expref: 14 pid: 5822 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351247.912061:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:1.0:1789351247.912072:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+14:2348:x1876270616977024:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351247.912092:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351247.912099:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df718d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d67 expref: 14 pid: 5822 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.912113:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df718d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d67 expref: 14 pid: 5822 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.912152:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df718d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d67 expref: 14 pid: 5822 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.912174:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2cc886ea00) 00010000:00010000:1.0:1789351247.912180:0:6676:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df71da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.912191:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df71da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.912199:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df71da lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351247.912232:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351247.912317:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+13:2348:x1876270616977024:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 245us (3500us total) trans 0 rc 0/0 00010000:00010000:3.0:1789351247.912323:0:10562:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df71da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351247.912325:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00010000:00010000:3.0:1789351247.912331:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df71da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789351247.913810:0:10562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1789351247.914048:0:10562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1789351247.914101:0:10562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1789351247.914213:0:10562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc2c6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10562:1876270626425984:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789351247.914325:0:10562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351247.914464:0:10562:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cffa719c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351247.914612:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626425984 00000100:00100000:1.0:1789351247.914686:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626425984 00000100:00100000:1.0:1789351247.914796:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789351247.914808:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10562:x1876270626425984:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789351247.914921:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10562:x1876270626425984:12345-0@lo:1000:mdt00_004.0 Request processed in 114us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351247.914929:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789351247.915001:0:10562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc2c6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10562:1876270626425984:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1789351247.915601:0:10562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789351247.915684:0:10562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc2c6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10562:1876270626426112:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789351247.915732:0:10562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351247.916172:0:10562:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cffa71840 going to sleep for 11 seconds 00000100:00100000:2.0:1789351247.916296:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626426112 00000100:00100000:2.0:1789351247.916303:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626426112 00000100:00100000:2.0:1789351247.916345:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789351247.916354:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10562:x1876270626426112:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789351247.916859:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:10562:x1876270626426112:12345-0@lo:1000:mdt00_004.0 Request processed in 503us (1123us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789351247.916868:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789351247.916960:0:10562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc2c6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10562:1876270626426112:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1789351247.917007:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df71da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917018:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df71da lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917026:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df71da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917039:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351247.917044:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df71da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917052:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df71da lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917072:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2cc886ea00) 00010000:00010000:3.0:1789351247.917076:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789351247.917082:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df71da lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917088:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df71da lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917131:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7108 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917138:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7108 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917143:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7108 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917147:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351247.917150:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7108 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917155:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7108 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917175:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2cc886ee00) 00010000:00010000:3.0:1789351247.917177:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789351247.917180:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7108 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917199:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7108 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917227:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df71e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917242:0:10562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7124 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d4b expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917253:0:10562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df71e1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917299:0:10562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d4b expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.917316:0:10562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7124 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d4b expref: 16 pid: 5822 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351247.917331:0:10562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10562:1876270626426240:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351247.917455:0:10562:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6e13000 going to sleep for 11 seconds 00000100:00100000:2.0:1789351247.920336:0:10562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f64700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10562:1876270626426240:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351247.920398:0:10562:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df71e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351247.921910:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351247.921976:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616977152 00000100:00100000:0.0:1789351247.921987:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616977152 00010000:00010000:0.0:1789351247.922049:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7124 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d4b expref: 17 pid: 5822 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351247.922088:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:0.0:1789351247.922100:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+17:2348:x1876270616977152:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351247.922118:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351247.922126:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7124 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d4b expref: 17 pid: 5822 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.922159:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d4b expref: 17 pid: 5822 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.922186:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7124 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d4b expref: 17 pid: 5822 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.922201:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2cc886ee00) 00010000:00010000:0.0:1789351247.922207:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df71e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.922219:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df71e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.922226:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df71e1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.922265:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351247.922346:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+16:2348:x1876270616977152:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 248us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351247.922354:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00010000:00010000:3.0:1789351247.922449:0:10562:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df71e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.922459:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df71e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.922482:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df71e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.922489:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df71e1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.922497:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df71e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.922504:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351247.922508:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df71e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.922516:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df71e1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.922526:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2cc886ee00) 00010000:00010000:3.0:1789351247.922529:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351247.922533:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df71e1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.922539:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df71e1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.922551:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df71d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.922558:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df71d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.922564:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df71d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.922575:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351247.922579:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df71d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.922585:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df71d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.922594:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2cc886ee00) 00010000:00010000:3.0:1789351247.922597:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789351247.922600:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df71d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.922606:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df71d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351247.926406:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+15:10431:x1876270616976896:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 20557us (20783us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1789351247.926425:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 82 00000020:00080000:3.0:1789351247.926433:0:10562:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789351247.926707:0:11642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789351247.926712:0:11642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789351247.926748:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789351247.926755:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789351247.931156:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351247.931254:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616977408 00000100:00100000:2.0:1789351247.931266:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616977408 00000100:00100000:2.0:1789351247.931388:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:2.0:1789351247.931402:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+15:10431:x1876270616977408:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789351247.932917:0:5826:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789351247.933034:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1789351247.933112:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df71e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.933147:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df71e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.933161:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df71e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.933172:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df71e8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.933180:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df71e8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.933254:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df71e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351247.933324:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789351247.933496:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+17:10431:x1876270616977408:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 2093us (2351us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789351247.933509:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000020:00080000:0.0:1789351247.933517:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789351247.934096:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351247.934107:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df71e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.934116:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031400 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351247.934121:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df71e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.934131:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df71e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.934163:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d2cc886e300) 00010000:00010000:3.0:1789351247.934166:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789351247.934173:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df71e8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351247.934179:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df71e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351247.934679:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351247.934683:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351247.934691:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789351248.090255:0:11963:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789351248.090269:0:11963:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789351248.090324:0:11963:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789351248.090335:0:11963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789351248.187766:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.187880:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616977664 00000100:00100000:0.0:1789351248.187893:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616977664 00000100:00100000:0.0:1789351248.188039:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00100000:0.0:1789351248.188052:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+17:10441:x1876270616977664:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789351248.188087:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351248.188114:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df71ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d83 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.188484:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.188509:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.188525:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351248.188539:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1789351248.188745:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df71ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d83 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.188766:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d83 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.188775:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:0.0:1789351248.188778:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789351248.188783:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0031600, rc 0) 00000100:00100000:0.0:1789351248.188857:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+19:10441:x1876270616977664:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 808us (1106us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1789351248.188865:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00080000:3.0:1789351248.188922:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789351248.196720:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351248.203884:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616977792 00000100:00100000:2.0:1789351248.203907:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616977792 00000100:00100000:2.0:1789351248.203988:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:2.0:1789351248.204001:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+19:10441:x1876270616977792:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:2.0:1789351248.204107:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7204 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.204128:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7204 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.204142:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7204 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.204160:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df720b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.204168:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df720b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.204175:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df720b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.204582:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7212 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.204591:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.204609:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789351248.204658:0:9467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.204672:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7204 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.204678:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7204 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.204686:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7204 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.204693:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351248.204698:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7204 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.204706:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7204 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.204719:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:2.0:1789351248.204722:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351248.204733:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7204 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.207214:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7204 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.207242:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df720b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.207262:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df720b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.207270:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df720b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.207276:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351248.207291:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df720b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.207307:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df720b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.207327:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2ce9e1aa00) 00010000:00010000:2.0:1789351248.207330:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351248.207335:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df720b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.207341:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df720b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.207373:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.207380:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7212 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.207386:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.207391:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351248.207402:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.207408:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7212 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.207417:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1a800) 00010000:00010000:2.0:1789351248.207419:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351248.207422:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7212 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.207429:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7212 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351248.207704:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+19:10441:x1876270616977792:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 3699us (10989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351248.207717:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:1.0:1789351248.248451:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351248.249853:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616978048 00000100:00100000:3.0:1789351248.249872:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616978048 00000100:00100000:2.0:1789351248.250096:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:2.0:1789351248.250111:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+19:10444:x1876270616978048:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351248.250139:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351248.250176:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7219 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d8a expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.250279:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7220 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.250306:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7220 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.250320:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7220 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.250384:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7227 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.250394:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.250401:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.250932:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df722e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.250943:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df722e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.250951:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df722e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351248.250965:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789351248.251091:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7220 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.251099:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7220 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.251107:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7220 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.251114:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351248.251119:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7220 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.251140:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7220 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.251155:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:2.0:1789351248.251158:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351248.251163:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7220 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.251170:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df7220 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.251201:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.251208:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7227 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.251213:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7227 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.251219:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351248.251221:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7227 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.251227:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7227 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.251235:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2ce9e1a800) 00010000:00010000:2.0:1789351248.251238:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351248.251241:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7227 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.251256:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7227 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.251316:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7219 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d8a expref: 22 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.251331:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df722e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d8a expref: 21 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.251339:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1aa00) 00010000:00010000:2.0:1789351248.251341:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789351248.251343:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0200, rc 0) 00000100:00100000:2.0:1789351248.251556:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+21:10444:x1876270616978048:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1448us (3118us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789351248.251565:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:1.0:1789351248.254743:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.254871:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616978176 00000100:00100000:0.0:1789351248.254885:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616978176 00000100:00100000:0.0:1789351248.254990:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00100000:0.0:1789351248.255003:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+21:10444:x1876270616978176:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:0.0:1789351248.255099:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df723c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.255120:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df723c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.255160:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df723c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.255197:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df723c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.255204:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df723c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.255211:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df723c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.255218:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351248.255222:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df723c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.255231:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df723c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.255256:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1aa00) 00010000:00010000:0.0:1789351248.255260:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789351248.255266:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df723c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.255273:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df723c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351248.255657:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+21:10444:x1876270616978176:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 654us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351248.255667:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00100000:3.0:1789351248.258700:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.258773:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616978432 00000100:00100000:0.0:1789351248.258799:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616978432 00000100:00100000:0.0:1789351248.258880:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:0.0:1789351248.258888:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf03a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+21:10444:x1876270616978432:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1789351248.259151:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf03a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+22:10444:x1876270616978432:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 263us (463us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789351248.259158:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:2.0:1789351248.281992:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351248.282089:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616978688 00000100:00100000:3.0:1789351248.282103:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616978688 00000100:00100000:3.0:1789351248.282186:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:3.0:1789351248.282199:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+22:9974:x1876270616978688:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789351248.282235:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351248.282266:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7243 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d91 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.282472:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df724a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.282490:0:9467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df722e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d8a expref: 23 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.282500:0:9467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df724a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.282566:0:9467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df722e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d8a expref: 23 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.282581:0:9467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df722e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d8a expref: 23 pid: 10562 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351248.282597:0:9467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f65500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9467:1876270626426368:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351248.282722:0:9467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd5a69b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789351248.284623:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351248.284744:0:9467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f65500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9467:1876270626426368:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351248.284817:0:9467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df724a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351248.284927:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616978816 00000100:00100000:0.0:1789351248.284936:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616978816 00010000:00010000:0.0:1789351248.284985:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df722e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d8a expref: 24 pid: 10562 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351248.285119:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:0.0:1789351248.285131:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+24:2347:x1876270616978816:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351248.285149:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351248.285158:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df722e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d8a expref: 24 pid: 10562 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.285173:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df722e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d8a expref: 24 pid: 10562 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.285203:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df722e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d8a expref: 24 pid: 10562 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.285222:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1aa00) 00010000:00010000:0.0:1789351248.285228:0:6676:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df724a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.285260:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df724a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.285268:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df724a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.285313:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351248.285410:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+23:2347:x1876270616978816:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 280us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351248.285420:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00010000:00010000:3.0:1789351248.285666:0:9467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df724a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.285675:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df724a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351248.285698:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789351248.285888:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7243 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d91 expref: 24 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.285910:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df724a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d91 expref: 23 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.285918:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1aa00) 00010000:00010000:3.0:1789351248.285922:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789351248.285932:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105c00, rc 0) 00000100:00100000:3.0:1789351248.285986:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+23:9974:x1876270616978688:12345-192.168.201.52@tcp:101:bash.0 Request processed in 3790us (4009us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789351248.285994:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:1.0:1789351248.288667:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351248.288863:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616979072 00000100:00100000:2.0:1789351248.288876:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616979072 00000100:00100000:2.0:1789351248.288970:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:2.0:1789351248.288982:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+23:9974:x1876270616979072:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:2.0:1789351248.289349:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7258 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.289404:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.289418:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789351248.289506:0:10562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1789351248.289536:0:10562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008db5791 reply state 00000000912d95a4 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351248.289546:0:10562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789351248.289596:0:10562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789351248.289734:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+27:9974:x1876270616979072:12345-192.168.201.52@tcp:36:bash.0 Request processed in 753us (1083us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789351248.289743:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 88 00000020:00080000:2.0:1789351248.289749:0:10562:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1789351248.294458:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.294480:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7258 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.294488:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7258 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.294495:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351248.294500:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7258 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.294509:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7258 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.294530:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1aa00) 00010000:00010000:3.0:1789351248.294532:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351248.294537:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7258 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.294543:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7258 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351248.299322:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351248.299567:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616979200 00000100:00100000:2.0:1789351248.299581:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616979200 00000100:00100000:2.0:1789351248.299757:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:2.0:1789351248.299770:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+26:9974:x1876270616979200:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789351248.299804:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351248.299831:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df725f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d98 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.299913:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df725f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d98 expref: 27 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.299931:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df725f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d98 expref: 27 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.299954:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1aa00) 00010000:00010000:2.0:1789351248.299957:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789351248.299962:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1800, rc 0) 00000100:00100000:2.0:1789351248.300050:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+27:9974:x1876270616979200:12345-192.168.201.52@tcp:101:bash.0 Request processed in 283us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351248.300058:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:1.0:1789351248.302500:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.302632:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616979328 00000100:00100000:0.0:1789351248.302645:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616979328 00000100:00100000:0.0:1789351248.302722:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:0.0:1789351248.302734:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+6:9974:x1876270616979328:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789351248.302757:0:11341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351248.302784:0:11341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005603bb32/0xa6ea017771df7266 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7d9f expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789351248.302822:0:11341:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa7554f, atime: 0x6aa7554e, ctime: 0x6aa7554f, blocks: 0xb 00010000:00010000:0.0:1789351248.302854:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=192s v=(0 0) 00010000:00010000:0.0:1789351248.302859:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351248.302869:0:11341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005603bb32/0xa6ea017771df7266 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d9f expref: 7 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.302889:0:11341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005603bb32/0xa6ea017771df7266 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d9f expref: 7 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.302925:0:11341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0031200, rc 0) 00000100:00100000:0.0:1789351248.303059:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+7:9974:x1876270616979328:12345-192.168.201.52@tcp:101:bash.0 Request processed in 327us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351248.303067:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:1.0:1789351248.308581:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.308686:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616979456 00000100:00100000:0.0:1789351248.308699:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616979456 00002000:00010000:0.0:1789351248.308753:0:6666:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789351248.308760:0:6666:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cf9d66680 with x1876270616979456 ext(0->18446744073709551615) 00002000:00010000:0.0:1789351248.308775:0:6666:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2cf9d66680. 00000100:00100000:0.0:1789351248.308818:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:0.0:1789351248.308831:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8237986d-b9e8-417a-ac8f-a078390d268c+7:2348:x1876270616979456:12345-192.168.201.52@tcp:10:bash.0 00002000:00010000:0.0:1789351248.309235:0:6666:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789351248.309240:0:6666:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789351247 -> 1789351248 00002000:00010000:0.0:1789351248.309243:0:6666:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789351246 -> 1789351246 00002000:00010000:0.0:1789351248.309246:0:6666:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789351247 -> 1789351248 00002000:00010000:0.0:1789351248.309248:0:6666:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789351248.309339:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8237986d-b9e8-417a-ac8f-a078390d268c+8:2348:x1876270616979456:12345-192.168.201.52@tcp:10:bash.0 Request processed in 508us (770us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789351248.309350:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00002000:00010000:0.0:1789351248.309354:0:6666:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789351248.309406:0:6666:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cf9d66680 with x1876270616979456 ext(0->18446744073709551615) 00002000:00010000:0.0:1789351248.309413:0:6666:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2cf9d66680. 00000100:00100000:1.0:1789351248.371593:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351248.371727:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616979584 00000100:00100000:3.0:1789351248.371739:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616979584 00000100:00100000:3.0:1789351248.371812:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:3.0:1789351248.371823:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+27:10458:x1876270616979584:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:3.0:1789351248.371931:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df726d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.371951:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df726d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.371965:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df726d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.371981:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7274 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.371988:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.371995:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372335:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df727b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372344:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df727b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372352:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df727b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789351248.372448:0:9467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df727b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372463:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df726d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372479:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df726d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372487:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df726d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372493:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351248.372498:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df726d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372505:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df726d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372519:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:3.0:1789351248.372522:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351248.372527:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df726d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372533:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df726d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372549:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372555:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7274 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372560:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7274 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372565:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351248.372572:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7274 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372578:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7274 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372585:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2ce058f600) 00010000:00010000:3.0:1789351248.372587:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351248.372589:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7274 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372595:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7274 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372608:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df727b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372613:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df727b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372619:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df727b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372625:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351248.372627:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df727b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372632:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df727b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372638:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1aa00) 00010000:00010000:3.0:1789351248.372640:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351248.372646:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df727b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.372652:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df727b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351248.372861:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+27:10458:x1876270616979584:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 1038us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351248.372872:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:1.0:1789351248.406048:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351248.406174:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616979840 00000100:00100000:2.0:1789351248.406187:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616979840 00000100:00100000:2.0:1789351248.406307:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:2.0:1789351248.406320:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+27:10461:x1876270616979840:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351248.406349:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351248.406437:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7282 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7da6 expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.406558:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7289 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.406576:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7289 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.406589:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7289 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.406605:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7290 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.406611:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.406618:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407018:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7297 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407036:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407044:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351248.407057:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789351248.407182:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7289 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407189:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7289 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407194:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7289 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407198:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351248.407201:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7289 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407206:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7289 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407217:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:2.0:1789351248.407219:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351248.407223:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7289 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407227:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7289 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407237:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407246:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7290 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407249:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407252:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351248.407254:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407257:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7290 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407261:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2ce9e1a800) 00010000:00010000:2.0:1789351248.407262:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351248.407264:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7290 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407267:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7290 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407328:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7282 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7da6 expref: 30 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407343:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7297 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7da6 expref: 29 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.407350:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1aa00) 00010000:00010000:2.0:1789351248.407352:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789351248.407567:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1a00, rc 0) 00000100:00100000:2.0:1789351248.407647:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+29:10461:x1876270616979840:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1328us (1613us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789351248.407657:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:2.0:1789351248.410105:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.410206:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616979968 00000100:00100000:0.0:1789351248.410219:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616979968 00000100:00100000:0.0:1789351248.410304:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:0.0:1789351248.410316:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+29:10461:x1876270616979968:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:0.0:1789351248.410483:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df72a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.410504:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df724a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d91 expref: 29 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.410516:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df72a5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.410833:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df724a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d91 expref: 29 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.410850:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df724a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d91 expref: 29 pid: 9467 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351248.410868:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876270626426496:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789351248.411208:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ceeca1000 going to sleep for 11 seconds 00000100:00100000:1.0:1789351248.417333:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.418696:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876270626426496:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789351248.418739:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df72a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351248.419354:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616980224 00000100:00100000:3.0:1789351248.419378:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616980224 00000100:00100000:3.0:1789351248.419529:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:3.0:1789351248.419543:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+30:5580:x1876270616980224:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789351248.420902:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+31:5580:x1876270616980224:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 1354us (3576us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789351248.420916:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:1.0:1789351248.422843:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351248.423249:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616980352 00000100:00100000:3.0:1789351248.423261:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616980352 00010000:00010000:3.0:1789351248.423326:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df724a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d91 expref: 31 pid: 9467 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351248.423476:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:3.0:1789351248.423488:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+31:2348:x1876270616980352:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351248.423507:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351248.423515:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df724a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d91 expref: 31 pid: 9467 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.423531:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df724a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d91 expref: 31 pid: 9467 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.423576:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df724a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d91 expref: 31 pid: 9467 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.423595:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1aa00) 00010000:00010000:3.0:1789351248.423601:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df72a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.423612:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df72a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.423620:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df72a5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.423664:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351248.423731:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+30:2348:x1876270616980352:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 245us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351248.423740:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47 00010000:00010000:2.0:1789351248.423777:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df72a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.423787:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df72a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.423826:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df72a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.423834:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df72a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.423841:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df72a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.423848:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351248.423852:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df72a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.423860:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df72a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.423870:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1aa00) 00010000:00010000:2.0:1789351248.423873:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789351248.423877:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df72a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.423893:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df72a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351248.423998:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+29:10461:x1876270616979968:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 13683us (13907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351248.424008:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:1.0:1789351248.430637:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.430686:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616980608 00000100:00100000:0.0:1789351248.430701:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616980608 00000100:00100000:0.0:1789351248.430785:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:0.0:1789351248.430799:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+29:10461:x1876270616980608:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1789351248.431138:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+30:10461:x1876270616980608:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 342us (519us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789351248.431155:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:1.0:1789351248.502785:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351248.503336:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616980864 00000100:00100000:3.0:1789351248.503352:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616980864 00000100:00100000:3.0:1789351248.503609:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:3.0:1789351248.503621:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+30:10472:x1876270616980864:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:3.0:1789351248.503655:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351248.503682:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df72ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7dad expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.503790:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df72b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.503829:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df72b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.503844:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df72b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.503862:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df72ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.503870:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df72ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.503877:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df72ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.505031:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df72c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.505044:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df72c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.505054:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df72c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351248.505067:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789351248.505182:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df72b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.505190:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df72b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.505198:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df72b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.505213:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351248.505218:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df72b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.505239:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df72b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.505255:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:3.0:1789351248.505257:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351248.505263:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df72b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.505268:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df72b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.505295:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df72ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.505301:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df72ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.505306:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df72ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.505311:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351248.505314:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df72ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.505320:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df72ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.505337:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2ce058f600) 00010000:00010000:3.0:1789351248.505340:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351248.505343:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df72ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.505349:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df72ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.506882:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df72ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dad expref: 33 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.506909:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df72c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dad expref: 32 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.506917:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1aa00) 00010000:00010000:3.0:1789351248.506919:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789351248.506923:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104c00, rc 0) 00000100:00100000:3.0:1789351248.507026:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+32:10472:x1876270616980864:12345-192.168.201.52@tcp:101:cat.0 Request processed in 3406us (4256us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789351248.507037:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:1.0:1789351248.514453:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.514571:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616981120 00000100:00100000:0.0:1789351248.514586:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616981120 00000100:00100000:0.0:1789351248.514678:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:0.0:1789351248.514700:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+32:10472:x1876270616981120:12345-192.168.201.52@tcp:35:cat.0 00000100:00100000:0.0:1789351248.515038:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+33:10472:x1876270616981120:12345-192.168.201.52@tcp:35:cat.0 Request processed in 347us (598us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789351248.515046:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:1.0:1789351248.528568:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351248.528703:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616981376 00000100:00100000:2.0:1789351248.528717:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616981376 00000100:00100000:2.0:1789351248.528798:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00100000:2.0:1789351248.528824:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+33:10473:x1876270616981376:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:2.0:1789351248.528921:0:10562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789351248.528955:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df72c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dad expref: 33 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.528979:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7297 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7da6 expref: 32 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.528988:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df725f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d98 expref: 31 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.528995:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1aa00) 00010000:00010000:2.0:1789351248.529005:0:10562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351248.529028:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df72cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.529040:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df72cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.529067:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df72cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.529080:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df72d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.529084:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df72d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.529089:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df72d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.529533:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.529543:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.529550:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789351248.530260:0:10562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00010000:00010000:2.0:1789351248.530396:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df72e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530408:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df72e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530418:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df72e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530427:0:10562:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df72e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530442:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df72e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530449:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df72e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530483:0:10562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789351248.530511:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530518:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72dd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530525:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530533:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351248.530539:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530547:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72dd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530560:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1a000) 00010000:00010000:3.0:1789351248.530564:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351248.530564:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789351248.530571:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72dd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.530575:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df72e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530580:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72dd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.530591:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1e00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351248.530597:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df72e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530608:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df72cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.530618:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df72e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530625:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df72cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.530633:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d2ce9e1a000) 00010000:00010000:2.0:1789351248.530634:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df72cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.530639:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789351248.530645:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df72e4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530646:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351248.530652:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df72cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.530657:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df72e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530663:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df72cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530678:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:3.0:1789351248.530679:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351248.530681:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351248.530683:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351248.530686:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df72cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.530695:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df72cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.530699:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1789351248.530708:0:10562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3443578 reply state 0000000085356de0 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df72d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351248.530720:0:10562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789351248.530862:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+32:10473:x1876270616981376:12345-192.168.201.52@tcp:36:rm.0 Request processed in 2034us (2301us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789351248.530873:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 94 00010000:00010000:0.0:1789351248.537093:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df72d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.537120:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df72d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.537130:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df72d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.537137:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351248.537144:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df72d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.537154:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df72d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.537179:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2ce9e1a800) 00010000:00010000:0.0:1789351248.537183:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351248.537189:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df72d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.537223:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df72d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351248.561415:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351248.564905:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616981632 00000100:00100000:2.0:1789351248.564926:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616981632 00000100:00100000:2.0:1789351248.565875:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 95 00000100:00100000:2.0:1789351248.565894:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+31:10479:x1876270616981632:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789351248.565937:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351248.565968:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df72eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7db4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.566248:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.566268:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.566293:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.566312:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df72f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.566321:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df72f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.566329:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df72f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789351248.569734:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789351248.570213:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7300 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.570235:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.570250:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.570337:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.570346:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.570353:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.570387:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351248.570393:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.570402:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.570418:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:2.0:1789351248.570422:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351248.570429:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.570436:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df72f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789351248.570453:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0c4b411 reply state 0000000031197356 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df72f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351248.570462:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789351248.570508:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df72eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7db4 expref: 34 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.570538:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7db4 expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.570546:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:2.0:1789351248.570549:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789351248.570551:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1a00, rc 0) 00000100:00100000:2.0:1789351248.571699:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+34:10479:x1876270616981632:12345-192.168.201.52@tcp:101:bash.0 Request processed in 5800us (10337us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789351248.571713:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 95 00000100:00100000:1.0:1789351248.576346:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351248.576474:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616981760 00000100:00100000:3.0:1789351248.576487:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616981760 00000100:00100000:3.0:1789351248.576580:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:3.0:1789351248.576605:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:2348:x1876270616981760:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789351248.576631:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351248.576664:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df730e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7dbb expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789351248.576682:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789351248.576698:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351248.576725:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=193s v=(0 0) 00010000:00010000:3.0:1789351248.576730:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351248.576742:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df730e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dbb expref: 6 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.576792:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df730e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dbb expref: 6 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.576810:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105c00, rc 0) 00000100:00100000:3.0:1789351248.576887:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+6:2348:x1876270616981760:12345-192.168.201.52@tcp:101:bash.0 Request processed in 295us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351248.576896:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00010000:00010000:2.0:1789351248.577348:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df72f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.577412:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df72f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.577421:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df72f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.577428:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351248.577434:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df72f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.577497:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df72f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.577516:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2ce9e1aa00) 00010000:00010000:2.0:1789351248.577519:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351248.577524:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df72f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.577541:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df72f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351248.581696:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.581856:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616981888 00000100:00100000:0.0:1789351248.581870:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616981888 00000100:00100000:0.0:1789351248.581979:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:0.0:1789351248.581993:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+6:10479:x1876270616981888:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789351248.582022:0:11341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351248.582048:0:11341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7dc2 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.582101:0:11341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df730e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dbb expref: 7 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.582111:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351248.582116:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351248.582121:0:11341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc2 expref: 7 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.582167:0:11341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df730e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dbb expref: 7 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.582183:0:11341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df730e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dbb expref: 7 pid: 6663 timeout: 293 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351248.582225:0:11341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11341:1876270626426624:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789351248.582394:0:11341:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ceeca1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789351248.587922:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351248.588941:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616982016 00000100:00100000:2.0:1789351248.588960:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616982016 00010000:00010000:2.0:1789351248.589026:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df730e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dbb expref: 8 pid: 6663 timeout: 293 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351248.589154:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:2.0:1789351248.589168:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+8:2348:x1876270616982016:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789351248.589191:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351248.589223:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df730e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dbb expref: 8 pid: 6663 timeout: 293 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.589240:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df730e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dbb expref: 8 pid: 6663 timeout: 293 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.589291:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351248.589298:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351248.589313:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc2 expref: 8 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.589325:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc2 expref: 8 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.589604:0:11341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df730e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dbb expref: 8 pid: 6663 timeout: 293 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351248.589625:0:11341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11341:1876270626426624:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351248.589663:0:11341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc2 expref: 7 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.589677:0:11341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0030800, rc 0) 00010000:00010000:2.0:1789351248.589691:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc2 expref: 7 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351248.589719:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5808:1876270626426752:192.168.201.52@tcp:105: 00000100:00100000:1.0:1789351248.589824:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+7:10479:x1876270616981888:12345-192.168.201.52@tcp:101:bash.0 Request processed in 7834us (8143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351248.589832:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:2.0:1789351248.589839:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2a63180 going to sleep for 11 seconds 00000100:00100000:3.0:1789351248.593029:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.593344:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616982272 00000100:00100000:0.0:1789351248.593392:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616982272 00000100:00100000:0.0:1789351248.593473:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:0.0:1789351248.593486:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+33:10479:x1876270616982272:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:0.0:1789351248.593958:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+34:10479:x1876270616982272:12345-192.168.201.52@tcp:35:bash.0 Request processed in 474us (943us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789351248.593965:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:2.0:1789351248.597907:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5808:1876270626426752:192.168.201.52@tcp:105: 00010000:00010000:2.0:1789351248.597943:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789351248.598094:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:2348:x1876270616982016:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 8918us (10179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351248.598109:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:3.0:1789351248.674470:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351248.674606:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616982400 00000100:00100000:2.0:1789351248.674619:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616982400 00000100:00100000:2.0:1789351248.674697:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:2.0:1789351248.674711:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+34:10495:x1876270616982400:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351248.674749:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351248.674779:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df731c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7dc9 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.674870:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7323 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.674888:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.674899:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351248.674981:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1789351248.674985:0:9467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351248.675024:0:9467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.675056:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df731c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc9 expref: 36 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.675078:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc9 expref: 35 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.675087:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:2.0:1789351248.675090:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789351248.675094:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0800, rc 0) 00000100:00100000:2.0:1789351248.675170:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+35:10495:x1876270616982400:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 463us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351248.675178:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:0.0:1789351248.681503:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351248.681653:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616982656 00000100:00100000:2.0:1789351248.681667:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616982656 00000100:00100000:2.0:1789351248.681750:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:2.0:1789351248.681763:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+35:10495:x1876270616982656:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351248.681793:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351248.681821:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df732a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7dd0 expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.681961:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7331 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.681977:0:10562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7300 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7db4 expref: 36 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.682011:0:10562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7331 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.682055:0:10562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7db4 expref: 36 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.682069:0:10562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7300 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7db4 expref: 36 pid: 5822 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351248.682085:0:10562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d45f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10562:1876270626426880:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351248.682216:0:10562:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2a63180 going to sleep for 11 seconds 00000100:00100000:3.0:1789351248.686643:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351248.686646:0:10562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d45f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10562:1876270626426880:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351248.686686:0:10562:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7331 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351248.686782:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616982784 00000100:00100000:0.0:1789351248.686791:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616982784 00010000:00010000:0.0:1789351248.686842:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7300 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7db4 expref: 37 pid: 5822 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351248.686894:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:0.0:1789351248.686907:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6583850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+37:2348:x1876270616982784:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351248.686930:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351248.686939:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7300 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7db4 expref: 37 pid: 5822 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.686956:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7db4 expref: 37 pid: 5822 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.687016:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7300 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7db4 expref: 37 pid: 5822 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.687036:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:0.0:1789351248.687042:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7331 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.687054:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7331 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.687062:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7331 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.687103:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351248.687238:0:10562:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7331 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.687246:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7331 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351248.687269:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:0.0:1789351248.688614:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6583850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+37:2348:x1876270616982784:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 1696us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351248.688631:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00010000:00010000:2.0:1789351248.688870:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df732a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dd0 expref: 37 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.688897:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7331 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dd0 expref: 36 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.688926:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:2.0:1789351248.688929:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789351248.688933:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1200, rc 0) 00000100:00100000:2.0:1789351248.688991:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+36:10495:x1876270616982656:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 7232us (7503us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789351248.688998:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:1.0:1789351248.693127:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351248.693259:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616983040 00000100:00100000:2.0:1789351248.693284:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616983040 00000100:00100000:3.0:1789351248.693736:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 98 00000100:00100000:3.0:1789351248.693755:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+36:10495:x1876270616983040:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351248.693793:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351248.693797:0:9467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789351248.693831:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7331 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dd0 expref: 36 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.693853:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2ce9e1af00) 00010000:00010000:3.0:1789351248.693867:0:9467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351248.693886:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df733f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7dd7 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.694012:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7346 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.694045:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.694057:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351248.694073:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789351248.694230:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df733f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dd7 expref: 38 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.694248:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7346 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dd7 expref: 37 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.694256:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2ce058f100) 00010000:00010000:3.0:1789351248.694259:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789351248.694262:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105000, rc 0) 00000100:00100000:3.0:1789351248.694655:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+37:10495:x1876270616983040:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 905us (1541us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789351248.694664:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 98 00000100:00100000:1.0:1789351248.698249:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351248.698383:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616983168 00000100:00100000:2.0:1789351248.698403:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616983168 00000100:00100000:2.0:1789351248.698506:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 99 00000100:00100000:2.0:1789351248.698528:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+37:10495:x1876270616983168:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351248.698561:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351248.698590:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7354 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7dde expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.698673:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7354 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dde expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.698691:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7354 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dde expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.698713:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2ce058f100) 00010000:00010000:2.0:1789351248.698716:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789351248.698721:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1000, rc 0) 00000100:00100000:2.0:1789351248.698791:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+38:10495:x1876270616983168:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 274us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351248.698827:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 99 00000100:00100000:1.0:1789351248.702460:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351248.702540:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616983296 00000100:00100000:3.0:1789351248.702556:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616983296 00000100:00100000:3.0:1789351248.702633:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:3.0:1789351248.702645:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+6:2348:x1876270616983296:12345-192.168.201.52@tcp:1:lfs.0 00010000:00010000:3.0:1789351248.702703:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df735b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.702731:0:6663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc2 expref: 6 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.702760:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351248.702766:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789351248.702771:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df735b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.702817:0:6663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc2 expref: 6 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.702834:0:6663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc2 expref: 6 pid: 11341 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351248.702853:0:6663:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6663:1876270626427008:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351248.702958:0:6663:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd5a699c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351248.705227:0:6663:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6663:1876270626427008:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351248.705268:0:6663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df735b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351248.708044:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.708206:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616983424 00000100:00100000:0.0:1789351248.708220:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616983424 00002000:00100000:0.0:1789351248.708442:0:6668:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d2cf9d6f480 x1876270616983424/t0(0) o4->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:504/0 lens 504/0 e 0 to 0 dl 1789351259 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789351248.708456:0:6668:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cf9d6f480 with x1876270616983424 ext(0->8) 00010000:00010000:0.0:1789351248.708537:0:6668:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc2 expref: 7 pid: 11341 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.708558:0:6668:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc2 expref: 7 pid: 11341 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789351248.708590:0:6668:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d2cf9d6f480 00000100:00100000:0.0:1789351248.708635:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:0.0:1789351248.708645:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270616983424:12345-192.168.201.52@tcp:4:lfs.0 00000100:00100000:0.0:1789351248.713392:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8237986d-b9e8-417a-ac8f-a078390d268c+9:2347:x1876270616983424:12345-192.168.201.52@tcp:4:lfs.0 Request processed in 4587us (5201us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789351248.713414:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00002000:00100000:0.0:1789351248.713434:0:6668:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d2cf9d6f480 x1876270616983424/t4294967302(0) o4->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:504/0 lens 504/448 e 0 to 0 dl 1789351259 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789351248.713446:0:6668:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cf9d6f480 with x1876270616983424 ext(0->8) 00010000:00010000:0.0:1789351248.713524:0:6668:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc2 expref: 9 pid: 11341 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.713548:0:6668:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc2 expref: 9 pid: 11341 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789351248.713559:0:6668:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d2cf9d6f480 00000100:00100000:3.0:1789351248.721662:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.721979:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616983552 00000100:00100000:0.0:1789351248.721994:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616983552 00010000:00010000:0.0:1789351248.722051:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc2 expref: 9 pid: 11341 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351248.722120:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:0.0:1789351248.722133:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+9:2348:x1876270616983552:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351248.722177:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789351248.722204:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789351248.722207:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789351248 00002000:00010000:0.0:1789351248.722210:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789351248 00002000:00010000:0.0:1789351248.722213:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789351248 00010000:00010000:0.0:1789351248.722221:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc2 expref: 9 pid: 11341 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.722238:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc2 expref: 9 pid: 11341 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.722659:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7315 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc2 expref: 9 pid: 11341 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.722684:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789351248.722689:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789351248.722697:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df735b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.722710:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df735b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.722801:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351248.722883:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+8:2348:x1876270616983552:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 752us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351248.722892:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00010000:00010000:1.0:1789351248.723998:0:6663:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df735b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.724017:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df735b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.724056:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df735b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.724066:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df735b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.724074:0:6663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df735b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.724195:0:6663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351248.724200:0:6663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df735b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.724210:0:6663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df735b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.724228:0:6663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df735b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.724236:0:6663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd73865f/0xa6ea017771df735b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351248.724650:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+7:2348:x1876270616983296:12345-192.168.201.52@tcp:1:lfs.0 Request processed in 21999us (22197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351248.724663:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:2.0:1789351248.727684:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351248.727851:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616983808 00000100:00100000:1.0:1789351248.727864:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616983808 00000100:00100000:1.0:1789351248.727929:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:1.0:1789351248.727942:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf03a2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+38:10495:x1876270616983808:12345-192.168.201.52@tcp:35:lfs.0 00000004:00010000:1.0:1789351248.728031:0:5825:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7346 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dd7 expref: 38 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789351248.728961:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789351248.729000:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789351248.729881:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789351248.729964:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7362 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.729989:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7354 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dde expref: 42 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.729999:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7362 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.730056:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7354 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dde expref: 42 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.730155:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7354 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dde expref: 42 pid: 5823 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351248.730177:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d6d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5825:1876270626427136:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789351248.730543:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc8a57600 going to sleep for 11 seconds 00000100:00100000:1.0:1789351248.732058:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d6d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5825:1876270626427136:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351248.732106:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7362 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351248.732762:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351248.732874:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616983936 00000100:00100000:3.0:1789351248.732884:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616983936 00010000:00010000:3.0:1789351248.732934:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7354 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dde expref: 43 pid: 5823 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351248.733022:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:3.0:1789351248.733035:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+43:2348:x1876270616983936:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351248.733054:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351248.733073:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7354 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dde expref: 43 pid: 5823 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.733112:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7354 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dde expref: 43 pid: 5823 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.733140:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7354 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dde expref: 43 pid: 5823 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.733158:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2ce058f100) 00010000:00010000:3.0:1789351248.733164:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7362 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.733176:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7362 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.733186:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7362 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.733287:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351248.733515:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+42:2348:x1876270616983936:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 480us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351248.733652:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00010000:00010000:1.0:1789351248.733723:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7362 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.733732:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7362 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789351248.733911:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1789351248.734178:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1789351248.734349:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d6d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1876270626427264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789351248.734735:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351248.734796:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626427264 00000100:00100000:1.0:1789351248.734803:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626427264 00000100:00100000:1.0:1789351248.734857:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789351248.734866:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5825:x1876270626427264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789351248.734953:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5825:x1876270626427264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351248.734959:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789351248.734986:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789351248.734998:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf9d7d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789351248.735032:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d6d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1876270626427264:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789351248.735936:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1789351248.736019:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d6d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1876270626427392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789351248.736085:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351248.736312:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc8a57600 going to sleep for 11 seconds 00000100:00100000:0.0:1789351248.736725:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626427392 00000100:00100000:0.0:1789351248.736734:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626427392 00000100:00100000:0.0:1789351248.736817:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789351248.736829:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5825:x1876270626427392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789351248.737067:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5825:x1876270626427392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 233us (972us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789351248.737079:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789351248.737157:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d6d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1876270626427392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789351248.737229:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1789351248.737300:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7362 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.737311:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7362 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.737320:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7362 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.737327:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351248.737333:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7362 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.737342:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7362 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.737381:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2ce058f100) 00010000:00010000:2.0:1789351248.737385:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789351248.737633:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7362 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.737640:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7362 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789351248.737853:0:5825:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789351248.737999:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1789351248.738012:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 193183653359ns, next at 194183651123ns, rc = 0 00000001:00080000:2.0:1789351248.738018:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1789351248.738056:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2ce058f100) 00010000:00010000:2.0:1789351248.738060:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789351248.738083:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7346 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dd7 expref: 46 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351248.738223:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf03a2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+45:10495:x1876270616983808:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 10283us (10553us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1789351248.738232:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00000020:00080000:2.0:1789351248.738237:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789351248.742045:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.742224:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616984064 00000100:00100000:0.0:1789351248.742239:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616984064 00000100:00100000:0.0:1789351248.742337:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 100 00000100:00100000:0.0:1789351248.742351:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+45:10495:x1876270616984064:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789351248.742745:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351248.742778:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7369 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7de5 expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.742864:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7369 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7de5 expref: 46 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.742882:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7369 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7de5 expref: 46 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.742905:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:0.0:1789351248.742909:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789351248.742914:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0030800, rc 0) 00000100:00100000:0.0:1789351248.743030:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+46:10495:x1876270616984064:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 680us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351248.743039:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 100 00000100:00100000:3.0:1789351248.751673:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.751797:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616984320 00000100:00100000:0.0:1789351248.751811:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616984320 00000100:00100000:0.0:1789351248.751886:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:0.0:1789351248.751899:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+46:10495:x1876270616984320:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1789351248.752327:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+47:10495:x1876270616984320:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 429us (665us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1789351248.752337:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:2.0:1789351248.809935:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351248.810321:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616984448 00000100:00100000:3.0:1789351248.810334:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616984448 00000100:00100000:3.0:1789351248.810450:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00100000:3.0:1789351248.810463:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+47:10505:x1876270616984448:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:3.0:1789351248.810584:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7370 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810618:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7370 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810630:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7370 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810644:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7377 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810649:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810653:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810761:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df737e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810766:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df737e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810770:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df737e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789351248.810817:0:9467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df737e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810829:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7370 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810834:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7370 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810848:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7370 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810853:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351248.810857:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7370 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810863:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7370 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810874:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:3.0:1789351248.810877:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351248.810880:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7370 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810885:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7370 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810898:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810901:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7377 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810905:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7377 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810908:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351248.810910:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7377 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810920:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7377 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810924:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2ce058fc00) 00010000:00010000:3.0:1789351248.810926:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351248.810927:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7377 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810930:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7377 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810942:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df737e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810945:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df737e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810948:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df737e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810951:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351248.810952:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df737e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810956:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df737e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810959:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:3.0:1789351248.810961:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351248.810962:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df737e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351248.810972:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df737e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351248.811053:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+47:10505:x1876270616984448:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 593us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351248.811059:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 101 00000100:00100000:1.0:1789351248.844777:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351248.844917:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616984704 00000100:00100000:2.0:1789351248.844930:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616984704 00000100:00100000:2.0:1789351248.845014:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 102 00000100:00100000:2.0:1789351248.845029:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+47:10509:x1876270616984704:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351248.845060:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351248.845089:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df7385 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7dec expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845194:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df738c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845212:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df738c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845233:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df738c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845281:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df7393 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845291:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df7393 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845299:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df7393 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845527:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df739a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845537:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df739a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845545:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df739a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351248.845557:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789351248.845690:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df738c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845698:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df738c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845706:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df738c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845712:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351248.845717:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df738c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845737:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df738c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845751:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:2.0:1789351248.845755:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351248.845761:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df738c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845768:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df738c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845781:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df7393 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845786:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df7393 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845792:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df7393 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845796:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351248.845799:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df7393 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845804:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df7393 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845811:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2ce9e1aa00) 00010000:00010000:2.0:1789351248.845813:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351248.845815:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df7393 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845829:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df7393 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845875:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df7385 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dec expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845889:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df739a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dec expref: 49 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.845897:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:2.0:1789351248.845899:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789351248.845902:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0600, rc 0) 00000100:00100000:2.0:1789351248.845990:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+49:10509:x1876270616984704:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 965us (1230us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789351248.845999:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 102 00000100:00100000:0.0:1789351248.849652:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351248.849740:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616984832 00000100:00100000:2.0:1789351248.849752:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616984832 00000100:00100000:2.0:1789351248.849822:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 103 00000100:00100000:2.0:1789351248.849833:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+49:10509:x1876270616984832:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:2.0:1789351248.849923:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df73a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.849943:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df73a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.849957:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df73a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.850080:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df73a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.850090:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df73a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.850098:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df73a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.850105:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351248.850110:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df73a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.850118:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df73a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.850132:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:2.0:1789351248.850135:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789351248.850140:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df73a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.850147:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df73a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351248.850242:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+49:10509:x1876270616984832:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 411us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351248.850250:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 103 00000100:00100000:3.0:1789351248.853159:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.853507:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616985088 00000100:00100000:0.0:1789351248.853529:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616985088 00000100:00100000:0.0:1789351248.853598:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:0.0:1789351248.853610:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+49:10509:x1876270616985088:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1789351248.853940:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+50:10509:x1876270616985088:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 331us (796us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789351248.853948:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00010000:00010000:1.0:1789351248.865619:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351248.899675:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351248.900253:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616985344 00000100:00100000:2.0:1789351248.900266:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616985344 00000100:00100000:2.0:1789351248.900412:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 104 00000100:00100000:2.0:1789351248.900443:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+50:10519:x1876270616985344:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789351248.900481:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351248.900486:0:9467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789351248.900521:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7323 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dc9 expref: 50 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.900546:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:2.0:1789351248.900551:0:9467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351248.900566:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df73af lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7df3 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.900698:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df73b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.900713:0:9467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df739a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dec expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.900723:0:9467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df73b6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.900766:0:9467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df739a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dec expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.900783:0:9467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df739a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dec expref: 50 pid: 5823 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351248.900800:0:9467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d45180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9467:1876270626427520:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351248.900940:0:9467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6eb3480 going to sleep for 11 seconds 00000100:00100000:3.0:1789351248.903658:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.904332:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616985472 00000100:00100000:0.0:1789351248.904346:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616985472 00010000:00010000:0.0:1789351248.904463:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df739a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dec expref: 51 pid: 5823 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351248.904520:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:0.0:1789351248.904534:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+51:2347:x1876270616985472:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351248.904587:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351248.904597:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df739a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dec expref: 51 pid: 5823 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.904628:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df739a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dec expref: 51 pid: 5823 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.904658:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:0.0:1789351248.904664:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df73b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.904678:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df73b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.904687:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df73b6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.904716:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351248.904768:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df739a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dec expref: 51 pid: 5823 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351248.904796:0:9467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d45180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9467:1876270626427520:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789351248.904797:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+50:2347:x1876270616985472:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 262us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351248.904811:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00010000:00010000:2.0:1789351248.904832:0:9467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df73b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.904843:0:9467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df73b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.904850:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df73b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351248.904877:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789351248.905121:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df73af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7df3 expref: 51 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.905139:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df73b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7df3 expref: 50 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.905148:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:2.0:1789351248.905151:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789351248.905154:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0400, rc 0) 00000100:00100000:2.0:1789351248.905185:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+50:10519:x1876270616985344:12345-192.168.201.52@tcp:101:bash.0 Request processed in 4747us (5529us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789351248.905193:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 104 00000100:00100000:3.0:1789351248.917170:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.917316:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616985728 00000100:00100000:0.0:1789351248.917330:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616985728 00000100:00100000:0.0:1789351248.917445:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 105 00000100:00100000:0.0:1789351248.917460:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+50:10519:x1876270616985728:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:0.0:1789351248.917874:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df73c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.917897:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df73c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.917911:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df73c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789351248.917994:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1789351248.918024:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbf8436c reply state 00000000d926988d transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df73c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351248.918035:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789351248.918174:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+53:10519:x1876270616985728:12345-192.168.201.52@tcp:36:bash.0 Request processed in 717us (1017us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1789351248.918184:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 105 00000020:00080000:0.0:1789351248.918191:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789351248.922189:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df73c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.922225:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df73c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.922234:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df73c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.922241:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351248.922246:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df73c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.922256:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df73c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.922290:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:0.0:1789351248.922294:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351248.922300:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df73c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.922307:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df73c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351248.922761:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351248.922844:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616985856 00000100:00100000:1.0:1789351248.922860:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616985856 00000100:00100000:1.0:1789351248.922950:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 106 00000100:00100000:1.0:1789351248.922964:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+52:10519:x1876270616985856:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:1.0:1789351248.922999:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351248.923021:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df73cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7dfa expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.923129:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.923154:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df73b6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7df3 expref: 53 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.923165:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.923211:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df73b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7df3 expref: 53 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.923225:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df73b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7df3 expref: 53 pid: 9467 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351248.923243:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626427648:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789351248.923399:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc8a57600 going to sleep for 11 seconds 00000100:00100000:1.0:1789351248.926478:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626427648:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351248.926535:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351248.931181:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.933318:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616985984 00000100:00100000:0.0:1789351248.933340:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616985984 00010000:00010000:0.0:1789351248.933424:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df73b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7df3 expref: 54 pid: 9467 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351248.933482:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:0.0:1789351248.933496:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+54:2348:x1876270616985984:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351248.933529:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351248.933538:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df73b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7df3 expref: 54 pid: 9467 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.933555:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df73b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7df3 expref: 54 pid: 9467 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.933586:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df73b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7df3 expref: 54 pid: 9467 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.933609:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:0.0:1789351248.933615:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.933627:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.933636:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351248.933670:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351248.933780:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+53:2348:x1876270616985984:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 286us (2616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351248.933789:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00010000:00010000:1.0:1789351248.934239:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.934250:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351248.934328:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789351248.934335:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789351248.934401:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.934459:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df73cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dfa expref: 53 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.934478:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dfa expref: 52 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.934487:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:1.0:1789351248.934490:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789351248.934493:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5400, rc 0) 00000100:00100000:1.0:1789351248.934639:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+52:10519:x1876270616985856:12345-192.168.201.52@tcp:101:bash.0 Request processed in 11678us (11886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351248.934648:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 106 00000100:00100000:3.0:1789351248.945106:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351248.946331:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616986240 00000100:00100000:0.0:1789351248.946346:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616986240 00000100:00100000:0.0:1789351248.946476:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:0.0:1789351248.946488:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+52:10519:x1876270616986240:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:0.0:1789351248.946824:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+53:10519:x1876270616986240:12345-192.168.201.52@tcp:35:bash.0 Request processed in 337us (1732us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1789351248.946834:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:3.0:1789351248.995651:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351248.995846:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616986368 00000100:00100000:2.0:1789351248.995862:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616986368 00000100:00100000:2.0:1789351248.996001:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 107 00000100:00100000:2.0:1789351248.996033:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+53:10525:x1876270616986368:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351248.996069:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351248.996097:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df73d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e01 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.996185:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df73e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.996215:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df73e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.996229:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df73e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351248.996320:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1789351248.996324:0:9467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351248.996352:0:9467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df73e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.996435:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df73d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e01 expref: 55 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.996459:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df73e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e01 expref: 54 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351248.996470:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:2.0:1789351248.996473:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789351248.996478:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0800, rc 0) 00000100:00100000:2.0:1789351248.996557:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+54:10525:x1876270616986368:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 528us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351248.996576:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 107 00000100:00100000:3.0:1789351248.999292:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351248.999382:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616986496 00000100:00100000:1.0:1789351248.999396:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616986496 00000100:00100000:1.0:1789351248.999474:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 108 00000100:00100000:1.0:1789351248.999487:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+54:10525:x1876270616986496:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789351248.999514:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351248.999542:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df73e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e08 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.999630:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df73ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.999647:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df73ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.999660:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df73ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.999694:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df73f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.999700:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df73f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.999707:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df73f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.999860:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df73fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.999869:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df73fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.999876:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df73fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351248.999922:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789351248.999927:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789351248.999949:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df73fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.999962:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df73fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.999970:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df73ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.999977:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df73ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351248.999994:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df73ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.000001:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351249.000006:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df73ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.000014:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df73ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.000028:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:1.0:1789351249.000031:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351249.000037:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df73ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.000043:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df73ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.000058:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df73f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.000065:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df73f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.000070:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df73f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.000076:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351249.000079:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df73f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.000093:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df73f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.000103:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2cc3d1ce00) 00010000:00010000:1.0:1789351249.000116:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351249.000119:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df73f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.000125:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df73f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.000158:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df73e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e08 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.000172:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df73fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e08 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.000179:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:1.0:1789351249.000181:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789351249.000184:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5000, rc 0) 00000100:00100000:1.0:1789351249.000266:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+55:10525:x1876270616986496:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 781us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351249.000284:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 108 00000100:00100000:1.0:1789351249.003908:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351249.003965:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351249.004039:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616986752 00000100:00100000:3.0:1789351249.004052:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616986752 00000100:00100000:3.0:1789351249.004124:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:3.0:1789351249.004136:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+55:10525:x1876270616986752:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351249.004166:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351249.004192:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7403 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e0f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.004338:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.004390:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dfa expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.004418:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df73fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e08 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.004428:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.004472:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df73fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e08 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.004487:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df73fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e08 expref: 56 pid: 5822 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351249.004503:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc76680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626427776:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351249.004630:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dfa expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.004639:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dfa expref: 56 pid: 5824 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351249.004650:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc76300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626427904:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351249.004677:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd5a699c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789351249.005118:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616986880 00000100:00100000:0.0:1789351249.005125:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616986880 00010000:00010000:0.0:1789351249.005153:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df73fc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e08 expref: 57 pid: 5822 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351249.005189:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:0.0:1789351249.005198:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+57:2347:x1876270616986880:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351249.005208:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351249.005216:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df73fc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e08 expref: 57 pid: 5822 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351249.005228:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df73fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e08 expref: 57 pid: 5822 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351249.005250:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:0.0:1789351249.005255:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351249.005286:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351249.005292:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351249.005335:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+57:2347:x1876270616986880:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 138us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351249.005343:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:1.0:1789351249.009205:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351249.009404:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616987008 00000100:00100000:0.0:1789351249.009417:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616987008 00010000:00010000:0.0:1789351249.009471:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dfa expref: 57 pid: 5824 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351249.009520:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:0.0:1789351249.009532:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+57:2348:x1876270616987008:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351249.009551:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351249.009560:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dfa expref: 57 pid: 5824 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351249.009576:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dfa expref: 57 pid: 5824 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351249.009605:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:0.0:1789351249.009611:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351249.009622:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351249.009651:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351249.009678:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351249.009769:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+57:2348:x1876270616987008:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 238us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351249.009777:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00010000:00010000:3.0:1789351249.010968:0:5824:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.52@tcp) returned -22 from blocking AST (req@00000000b4908540 x1876270626427776) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df73fc lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e08 expref: 56 pid: 5822 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.010995:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df73fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e08 expref: 56 pid: 5822 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351249.011032:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc76680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626427776:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351249.011055:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df73d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7dfa expref: 55 pid: 5824 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351249.011065:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc76300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626427904:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351249.011098:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:3.0:1789351249.011108:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.011118:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.011124:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351249.011151:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789351249.011638:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7403 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e0f expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.011660:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e0f expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.011669:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:3.0:1789351249.011672:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789351249.011676:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104c00, rc 0) 00000100:00100000:3.0:1789351249.011781:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+55:10525:x1876270616986752:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 7647us (7888us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789351249.011800:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:1.0:1789351249.015633:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351249.015758:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616987264 00000100:00100000:0.0:1789351249.015771:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616987264 00000100:00100000:0.0:1789351249.015845:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:0.0:1789351249.015858:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6582850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+55:10525:x1876270616987264:12345-192.168.201.52@tcp:103:lfs.0 00010000:00010000:0.0:1789351249.015876:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351249.015910:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7369 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7de5 expref: 55 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351249.015934:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:0.0:1789351249.015940:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351249.016012:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6582850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+54:10525:x1876270616987264:12345-192.168.201.52@tcp:103:lfs.0 Request processed in 157us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351249.016020:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:0.0:1789351249.017739:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351249.017814:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616987392 00000100:00100000:1.0:1789351249.017842:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616987392 00000100:00100000:1.0:1789351249.017902:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:1.0:1789351249.017913:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+54:10525:x1876270616987392:12345-192.168.201.52@tcp:58:lfs.0 00010000:00010000:1.0:1789351249.018053:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7418 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.018072:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7418 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.018085:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7418 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789351249.018353:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1789351249.022685:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+54:10525:x1876270616987392:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 4762us (4944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351249.022701:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:2.0:1789351249.025458:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351249.025639:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616987520 00000100:00100000:0.0:1789351249.025653:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616987520 00000100:00100000:0.0:1789351249.025737:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00100000:0.0:1789351249.025750:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+54:10525:x1876270616987520:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789351249.025776:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351249.025820:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df741f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e16 expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351249.025899:0:10562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7418 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351249.025911:0:10562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df741f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e16 expref: 55 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351249.025934:0:10562:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7418 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351249.025951:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df741f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e16 expref: 55 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351249.025967:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:0.0:1789351249.025970:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789351249.025974:0:10562:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df741f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e16 expref: 55 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351249.025982:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0031400, rc 0) 00000100:00100000:0.0:1789351249.026066:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+55:10525:x1876270616987520:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 318us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351249.026073:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00100000:2.0:1789351249.569680:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626428032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789351249.569798:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351249.570046:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626428032 00000100:00100000:3.0:1789351249.570057:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626428032 00000100:00100000:3.0:1789351249.570125:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789351249.570136:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3289:x1876270626428032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789351249.570179:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789351249.575295:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626428032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789351249.575548:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3289:x1876270626428032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5410us (5746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351249.575561:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1789351249.889574:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789351249.955626:0:11642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789351249.955641:0:11642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789351249.955737:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789351249.955751:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789351249.955944:0:11642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d67b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11642:1876270626428160:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789351249.956105:0:11642:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0c0f600 going to sleep for 11 seconds 00000100:00100000:2.0:1789351249.961407:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351249.961507:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616987648 00000100:00100000:3.0:1789351249.961520:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616987648 00000100:00100000:3.0:1789351249.961601:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:3.0:1789351249.961616:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+56:10526:x1876270616987648:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789351249.961662:0:5824:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789351249.961813:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+56:10526:x1876270616987648:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 200us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351249.961825:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:0.0:1789351249.962216:0:11642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d67b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11642:1876270626428160:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789351249.970042:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351249.970656:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616987776 00000100:00100000:2.0:1789351249.970671:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616987776 00000100:00100000:2.0:1789351249.970753:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 113 00000100:00100000:2.0:1789351249.970767:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+55:10526:x1876270616987776:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789351249.970874:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7426 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.970895:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7426 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.970909:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7426 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.970928:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df742d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.970935:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df742d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.970942:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df742d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.970970:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7434 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971000:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971007:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351249.971073:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789351249.971079:0:9467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351249.971097:0:9467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971110:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7426 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971117:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7426 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971124:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7426 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971131:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351249.971136:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7426 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971144:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7426 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971157:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2cc3d1c800) 00010000:00010000:2.0:1789351249.971161:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351249.971167:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7426 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971185:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7426 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971203:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df742d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971208:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df742d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971214:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df742d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971218:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351249.971222:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df742d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971227:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df742d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971235:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8d2ce9e1aa00) 00010000:00010000:2.0:1789351249.971238:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351249.971240:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df742d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971246:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df742d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971270:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971277:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7434 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971288:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971292:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351249.971295:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971301:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7434 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971309:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:2.0:1789351249.971311:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351249.971314:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7434 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351249.971319:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7434 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351249.971484:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+55:10526:x1876270616987776:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 718us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351249.971493:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 113 00000100:00100000:1.0:1789351249.978091:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351249.978281:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616988032 00000100:00100000:3.0:1789351249.978296:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616988032 00000100:00100000:3.0:1789351249.978631:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 114 00000100:00100000:3.0:1789351249.978647:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+55:10526:x1876270616988032:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351249.978691:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351249.978723:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df743b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e1d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.978905:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7442 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.978925:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.978939:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351249.978954:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789351249.979094:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.979103:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7442 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.979111:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7442 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.979118:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351249.979124:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7442 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.979133:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7442 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.979150:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:3.0:1789351249.979168:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789351249.979175:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7442 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.979193:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7442 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.979263:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df743b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e1d expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.979275:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2cc3d1c800) 00010000:00010000:3.0:1789351249.979278:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789351249.979282:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df743b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e1d expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351249.979295:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104a00, rc 0) 00000100:00100000:3.0:1789351249.979433:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+56:10526:x1876270616988032:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 789us (1355us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1789351249.979441:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 114 00000100:00100000:3.0:1789351249.983662:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351249.984168:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616988160 00000100:00100000:1.0:1789351249.984181:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616988160 00000100:00100000:1.0:1789351249.984242:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 115 00000100:00100000:1.0:1789351249.984252:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+56:10526:x1876270616988160:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789351249.984352:0:5824:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789351249.984885:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+56:10526:x1876270616988160:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 631us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351249.984896:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 115 00000100:00100000:2.0:1789351249.988439:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351249.988806:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616988416 00000100:00100000:1.0:1789351249.988819:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616988416 00000100:00100000:1.0:1789351249.988894:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 116 00000100:00100000:1.0:1789351249.988923:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+56:10526:x1876270616988416:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789351249.988952:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351249.988956:0:10562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789351249.988990:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df73e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e01 expref: 56 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.989016:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:1.0:1789351249.989022:0:10562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789351249.989039:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7450 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e24 expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789351249.989651:0:10562:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789351249.992316:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7457 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.992342:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.992378:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.992503:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7450 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e24 expref: 58 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.992526:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7457 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e24 expref: 57 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.992536:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2cc3d1ce00) 00010000:00010000:1.0:1789351249.992539:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789351249.992556:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4400, rc 0) 00000100:00100000:1.0:1789351249.992834:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+57:10526:x1876270616988416:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 3911us (4408us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789351249.992844:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 116 00000100:00100000:3.0:1789351249.996204:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351249.996340:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616988672 00000100:00100000:1.0:1789351249.996411:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616988672 00000100:00100000:1.0:1789351249.996497:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 117 00000100:00100000:1.0:1789351249.996507:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+57:10526:x1876270616988672:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789351249.996605:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351249.996635:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7457 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e24 expref: 57 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996656:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2cc3d1ce00) 00010000:00010000:1.0:1789351249.996668:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789351249.996696:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df7465 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996711:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df7465 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996720:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df7465 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996735:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df746c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x74c95251 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996742:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df746c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x74c95251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996749:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df746c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x74c95251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996837:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df7465 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996844:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df7465 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996849:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df7465 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996854:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351249.996858:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df7465 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996864:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df7465 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996871:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:1.0:1789351249.996874:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351249.996878:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df7465 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996883:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df7465 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996892:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df746c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x74c95251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996898:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df746c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x74c95251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996903:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df746c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x74c95251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996913:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351249.996916:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df746c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x74c95251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996922:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df746c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x74c95251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996930:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x74c95251 (ffff8d2cc3d1cf00) 00010000:00010000:1.0:1789351249.996933:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351249.996936:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df746c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x74c95251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351249.996942:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df746c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x74c95251 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351249.997047:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+56:10526:x1876270616988672:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 541us (857us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789351249.997054:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 117 00000100:00100000:2.0:1789351249.999899:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351250.000066:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616988800 00000100:00100000:1.0:1789351250.000081:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616988800 00000100:00100000:1.0:1789351250.000193:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 118 00000100:00100000:1.0:1789351250.000205:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+56:10526:x1876270616988800:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789351250.000234:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351250.000274:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df7473 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e2b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.000321:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df747a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.000404:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df747a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.000419:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df747a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.000565:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df7473 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e2b expref: 58 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.000588:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df747a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e2b expref: 57 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.000597:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:1.0:1789351250.000600:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789351250.000604:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5400, rc 0) 00000100:00100000:1.0:1789351250.000700:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+57:10526:x1876270616988800:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 497us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351250.000707:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 118 00000100:00100000:3.0:1789351250.003956:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351250.004517:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616989056 00000100:00100000:2.0:1789351250.004532:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616989056 00000100:00100000:2.0:1789351250.004629:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 119 00000100:00100000:2.0:1789351250.004644:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+57:10526:x1876270616989056:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789351250.004763:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7481 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789351250.004920:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789351250.004978:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.004994:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789351250.005569:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1789351250.005582:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 194451222989ns, next at 195451220085ns, rc = 0 00000004:00010000:2.0:1789351250.005915:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec065f6f reply state 0000000024d5b158 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351250.005929:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789351250.006144:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+59:10526:x1876270616989056:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 1499us (2462us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789351250.006165:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 119 00000100:00100000:1.0:1789351250.014752:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:2.0:1789351250.015742:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.015759:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7481 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.015768:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7481 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.015775:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351250.015793:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7481 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.015802:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7481 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.015851:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:2.0:1789351250.015854:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789351250.015862:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7481 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.015869:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7481 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351250.017116:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616989184 00000100:00100000:3.0:1789351250.017132:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616989184 00000100:00100000:3.0:1789351250.017213:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 120 00000100:00100000:3.0:1789351250.017223:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+58:10526:x1876270616989184:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351250.017245:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351250.017277:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7488 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e32 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.017404:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7488 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e32 expref: 59 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.017424:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7488 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e32 expref: 59 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.017447:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:3.0:1789351250.017450:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789351250.017455:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104a00, rc 0) 00000100:00100000:3.0:1789351250.017531:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+59:10526:x1876270616989184:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 308us (2806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351250.017538:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 120 00000100:00100000:0.0:1789351250.020017:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351250.020148:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616989312 00000100:00100000:3.0:1789351250.020161:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616989312 00000100:00100000:3.0:1789351250.020263:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:3.0:1789351250.020278:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+8:2347:x1876270616989312:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789351250.020695:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+9:2347:x1876270616989312:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 420us (692us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789351250.020704:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00080000:1.0:1789351250.021028:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789351250.023164:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351250.023280:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616989568 00000100:00100000:0.0:1789351250.023293:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616989568 00000100:00100000:0.0:1789351250.023593:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:0.0:1789351250.023608:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+59:10526:x1876270616989568:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789351250.023993:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+60:10526:x1876270616989568:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 387us (841us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789351250.024002:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:1.0:1789351250.026092:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351250.026212:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616989824 00000100:00100000:3.0:1789351250.026225:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616989824 00000100:00100000:3.0:1789351250.026335:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 121 00000100:00100000:3.0:1789351250.026347:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+60:10526:x1876270616989824:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789351250.026548:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+60:10526:x1876270616989824:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 202us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351250.026574:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 121 00000100:00100000:2.0:1789351250.028567:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351250.028775:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616989952 00000100:00100000:1.0:1789351250.028788:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616989952 00000100:00100000:0.0:1789351250.029000:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 122 00000100:00100000:0.0:1789351250.029014:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+60:10526:x1876270616989952:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789351250.029041:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351250.029067:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df748f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e39 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.029151:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7496 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.029166:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.029177:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351250.029239:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789351250.029271:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.029309:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df748f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e39 expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.029333:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7496 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e39 expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.029341:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:0.0:1789351250.029344:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789351250.029348:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0030e00, rc 0) 00000100:00100000:0.0:1789351250.029488:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+61:10526:x1876270616989952:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 476us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351250.029504:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 122 00000100:00100000:0.0:1789351250.032584:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351250.032823:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616990080 00000100:00100000:1.0:1789351250.032837:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616990080 00000100:00100000:1.0:1789351250.032915:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:1.0:1789351250.032929:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+9:2348:x1876270616990080:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789351250.032972:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351250.033002:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ab3fa0f/0xa6ea017771df749d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e40 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789351250.033042:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa75552, blocks: 0x1 00010000:00010000:1.0:1789351250.033061:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=194s v=(0 0) 00010000:00010000:1.0:1789351250.033065:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789351250.033075:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ab3fa0f/0xa6ea017771df749d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e40 expref: 10 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.033090:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009ab3fa0f/0xa6ea017771df749d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e40 expref: 10 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.033103:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4000, rc 0) 00000100:00100000:1.0:1789351250.033166:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+10:2348:x1876270616990080:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 242us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351250.033173:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:1.0:1789351250.035915:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351250.036071:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616990336 00000100:00100000:3.0:1789351250.036083:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616990336 00000100:00100000:3.0:1789351250.036146:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 123 00000100:00100000:3.0:1789351250.036158:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+61:10526:x1876270616990336:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789351250.036313:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+61:10526:x1876270616990336:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 156us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351250.036322:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 123 00000100:00100000:2.0:1789351250.038646:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351250.038987:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616990464 00000100:00100000:3.0:1789351250.039000:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616990464 00000100:00100000:3.0:1789351250.039074:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:3.0:1789351250.039087:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+10:10526:x1876270616990464:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351250.039110:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351250.039132:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df74a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e47 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.039168:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ab3fa0f/0xa6ea017771df749d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e40 expref: 11 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.039175:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351250.039179:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351250.039183:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df74a4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e47 expref: 11 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.039214:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ab3fa0f/0xa6ea017771df749d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e40 expref: 11 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.039243:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ab3fa0f/0xa6ea017771df749d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e40 expref: 11 pid: 6660 timeout: 294 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351250.039273:0:6661:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6661:1876270626428288:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351250.039435:0:6661:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc65ce000 going to sleep for 11 seconds 00000100:00100000:3.0:1789351250.042891:0:6661:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6661:1876270626428288:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351250.042943:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df74a4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e47 expref: 11 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.042972:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105e00, rc 0) 00000100:00100000:2.0:1789351250.043172:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+11:10526:x1876270616990464:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 4085us (4538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351250.043183:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:0.0:1789351250.043250:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351250.043440:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616990592 00000100:00100000:2.0:1789351250.043450:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616990592 00010000:00010000:2.0:1789351250.043492:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ab3fa0f/0xa6ea017771df749d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e40 expref: 11 pid: 6660 timeout: 294 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351250.043531:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:2.0:1789351250.043552:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+11:2347:x1876270616990592:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789351250.043570:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351250.043600:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ab3fa0f/0xa6ea017771df749d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e40 expref: 11 pid: 6660 timeout: 294 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.043615:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ab3fa0f/0xa6ea017771df749d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e40 expref: 11 pid: 6660 timeout: 294 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.043663:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ab3fa0f/0xa6ea017771df749d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e40 expref: 11 pid: 6660 timeout: 294 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.043680:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351250.043685:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351250.043695:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df74a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e47 expref: 10 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.043706:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df74a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e47 expref: 10 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.043750:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df74a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e47 expref: 10 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351250.043766:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5807:1876270626428416:192.168.201.52@tcp:105: 00000100:00100000:2.0:1789351250.043863:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cffa71000 going to sleep for 11 seconds 00000100:00100000:0.0:1789351250.047611:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351250.047801:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5807:1876270626428416:192.168.201.52@tcp:105: 00010000:00010000:2.0:1789351250.047847:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789351250.047937:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+10:2347:x1876270616990592:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 4386us (4686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351250.047951:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:1.0:1789351250.048248:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616990720 00000100:00100000:1.0:1789351250.048267:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616990720 00002000:00100000:1.0:1789351250.048324:0:6667:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d2cf9d64e00 x1876270616990720/t0(0) o4->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:506/0 lens 504/0 e 0 to 0 dl 1789351261 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789351250.048336:0:6667:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cf9d64e00 with x1876270616990720 ext(0->12) 00002000:00010000:1.0:1789351250.048342:0:6667:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2cf9d64e00 00000100:00100000:1.0:1789351250.048411:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:1.0:1789351250.048422:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8237986d-b9e8-417a-ac8f-a078390d268c+10:2347:x1876270616990720:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789351250.049710:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8237986d-b9e8-417a-ac8f-a078390d268c+12:2347:x1876270616990720:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 Request processed in 1279us (2105us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789351250.049724:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00002000:00100000:1.0:1789351250.049736:0:6667:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d2cf9d64e00 x1876270616990720/t4294967308(0) o4->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:506/0 lens 504/448 e 0 to 0 dl 1789351261 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789351250.049747:0:6667:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cf9d64e00 with x1876270616990720 ext(0->12) 00002000:00010000:1.0:1789351250.049753:0:6667:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2cf9d64e00 00000100:00100000:0.0:1789351250.051852:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351250.051975:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616990848 00000100:00100000:3.0:1789351250.051986:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616990848 00000100:00100000:3.0:1789351250.052045:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 124 00000100:00100000:3.0:1789351250.052056:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+61:10526:x1876270616990848:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789351250.097085:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:0.0:1789351250.097149:0:5844:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2cc65cecc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789351250.097154:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d2cc6f47700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2cc65ceb40 00000020:00080000:0.0:1789351250.097158:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d2cc6f47d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2cf7593800 00000004:00080000:0.0:1789351250.097197:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1789351250.097220:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789351250.097312:0:5844:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2cffa71540 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789351250.097316:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d2ce6e68600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2cffa719c0 00000020:00080000:0.0:1789351250.097318:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d2ce6e68000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2ceee88800 00000020:00080000:0.0:1789351250.097331:0:5844:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1789351250.097386:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1789351250.097694:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789351250.097849:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626428544:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789351250.097947:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351250.098076:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626428544 00000100:00100000:3.0:1789351250.098084:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626428544 00000100:00100000:3.0:1789351250.098138:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789351250.098147:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3286:x1876270626428544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789351250.098174:0:6663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1789351250.098209:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa75550, atime: 0x6aa75550, ctime: 0x6aa75550, blocks: 0x1 00010000:00010000:3.0:1789351250.098217:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df74ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.098235:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=194s v=(0 0) 00010000:00010000:3.0:1789351250.098246:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351250.098263:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df74ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.098287:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df74ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.098299:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df74ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789351250.098305:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789351250.098308:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df74ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.098326:0:6663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789351250.098344:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789351250.098353:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df74ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.098449:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105800 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351250.098454:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df74ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.098464:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df74ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.098486:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df74ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.098494:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df74ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.098529:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351250.098531:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351250.098533:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789351250.098736:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+15:10526:x1876270616990848:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 46678us (46894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351250.098749:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 124 00000100:00100000:1.0:1789351250.099143:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626428672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789351250.099187:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351250.099238:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626428672 00000100:00100000:1.0:1789351250.099245:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626428672 00000100:00100000:1.0:1789351250.099298:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789351250.099306:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3287:x1876270626428672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789351250.099325:0:11341:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1789351250.099347:0:11341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b958b3b/0xa6ea017771df74b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.099395:0:11341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005603bb32/0xa6ea017771df7266 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d9f expref: 11 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.099404:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789351250.099408:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789351250.099412:0:11341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b958b3b/0xa6ea017771df74b2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.099443:0:11341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005603bb32/0xa6ea017771df7266 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d9f expref: 11 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.099458:0:11341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005603bb32/0xa6ea017771df7266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d9f expref: 11 pid: 11341 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351250.099478:0:11341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11341:1876270626428800:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789351250.099535:0:11341:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc8a570c0 going to sleep for 11 seconds 00000100:00080000:1.0:1789351250.099546:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789351250.100121:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626428928:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789351250.100159:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351250.100423:0:6660:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789351250.100434:0:6660:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1789351250.100755:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626428928 00000100:00100000:2.0:1789351250.100763:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626428928 00000100:00100000:1.0:1789351250.101606:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789351250.101620:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3288:x1876270626428928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789351250.102037:0:11977:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789351250.102041:0:11977:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789351250 00002000:00010000:1.0:1789351250.102044:0:11977:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789351250.102046:0:11977:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789351250 -> 1789351250 00002000:00010000:1.0:1789351250.102049:0:11977:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789351250.102149:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3288:x1876270626428928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 532us (1987us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789351250.102157:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:1.0:1789351250.102223:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2cc31d0000/2, rc 0, transno 4294967309 00000100:00100000:1.0:1789351250.102231:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626428928:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789351250.102754:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351250.102815:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616990976 00000100:00100000:1.0:1789351250.102825:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616990976 00000100:00100000:3.0:1789351250.102960:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3286:x1876270626428544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4812us (5011us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789351250.102970:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789351250.103085:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:1.0:1789351250.103094:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+12:2347:x1876270616990976:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789351250.103148:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351250.103175:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616991104 00000100:00100000:1.0:1789351250.103176:0:11341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11341:1876270626428800:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351250.103178:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616991104 00010000:00010000:2.0:1789351250.103202:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005603bb32/0xa6ea017771df7266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d9f expref: 13 pid: 11341 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.103205:0:11341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b958b3b/0xa6ea017771df74b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351250.103232:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:2.0:1789351250.103238:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+13:2348:x1876270616991104:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789351250.103250:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351250.103268:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005603bb32/0xa6ea017771df7266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d9f expref: 13 pid: 11341 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.103282:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005603bb32/0xa6ea017771df7266 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d9f expref: 13 pid: 11341 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.103309:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005603bb32/0xa6ea017771df7266 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d9f expref: 13 pid: 11341 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.103329:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789351250.103335:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789351250.103341:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b958b3b/0xa6ea017771df74b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.103403:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b958b3b/0xa6ea017771df74b2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.103433:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789351250.103487:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+12:2348:x1876270616991104:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 248us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351250.103501:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 57 00010000:00010000:1.0:1789351250.103973:0:11341:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b958b3b/0xa6ea017771df74b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.103985:0:11341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b958b3b/0xa6ea017771df74b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.103997:0:11341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b958b3b/0xa6ea017771df74b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.104006:0:11341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b958b3b/0xa6ea017771df74b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.104027:0:11341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789351250.104616:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2cffc7dc00/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789351250.104627:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626428544:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789351250.107635:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3287:x1876270626428672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8269us (8386us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789351250.107654:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1789351250.107863:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789351250.107874:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b958b3b/0xa6ea017771df74b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.107890:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351250.107896:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b958b3b/0xa6ea017771df74b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.107910:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b958b3b/0xa6ea017771df74b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.107946:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b958b3b/0xa6ea017771df74b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.107955:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b958b3b/0xa6ea017771df74b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.107980:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351250.107982:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351250.107985:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789351250.108033:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2cc31d1c00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789351250.108041:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626428672:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1789351250.131950:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1789351250.131975:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1789351250.131985:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1789351250.131992:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1789351250.132179:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+6:2347:x1876270616990976:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 29077us (29420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351250.132194:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:2.0:1789351250.134558:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351250.134708:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616991360 00000100:00100000:0.0:1789351250.134721:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616991360 00000100:00100000:0.0:1789351250.134796:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 125 00000100:00100000:0.0:1789351250.134808:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+15:10526:x1876270616991360:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789351250.134890:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351250.134924:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7496 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e39 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.134950:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:0.0:1789351250.134956:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789351250.134998:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df74b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.135014:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df74b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.135025:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df74b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789351250.135328:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2c2aebd reply state 000000001d7f11f9 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df74b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351250.135418:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789351250.135608:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+16:10526:x1876270616991360:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 802us (1062us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789351250.135618:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 125 00010000:00010000:1.0:1789351250.137180:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df74b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.137199:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df74b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.137207:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df74b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.137216:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351250.137222:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df74b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.137261:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df74b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.137282:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:1.0:1789351250.137286:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351250.137295:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df74b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.137303:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df74b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351250.137446:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351250.137535:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616991488 00000100:00100000:1.0:1789351250.137546:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616991488 00000100:00100000:1.0:1789351250.137609:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:1.0:1789351250.137620:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8237986d-b9e8-417a-ac8f-a078390d268c+6:2348:x1876270616991488:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789351250.137901:0:11977:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789351250.137906:0:11977:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789351250 -> 1789351249 00002000:00010000:1.0:1789351250.137908:0:11977:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789351248 00002000:00010000:1.0:1789351250.137911:0:11977:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789351250 -> 1789351249 00002000:00010000:1.0:1789351250.137913:0:11977:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789351250.137980:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8237986d-b9e8-417a-ac8f-a078390d268c+7:2348:x1876270616991488:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 361us (538us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789351250.137989:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:0.0:1789351250.139820:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351250.139908:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616991744 00000100:00100000:3.0:1789351250.139920:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616991744 00000100:00100000:3.0:1789351250.139983:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:3.0:1789351250.139995:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+15:10526:x1876270616991744:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789351250.140079:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df74c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.140110:0:9467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df747a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e2b expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.140120:0:9467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df74c0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.140186:0:9467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df747a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e2b expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.140202:0:9467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df747a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e2b expref: 15 pid: 5824 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351250.140218:0:9467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9467:1876270626429056:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351250.140345:0:9467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc65cee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789351250.144032:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351250.144309:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616991872 00000100:00100000:0.0:1789351250.144322:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616991872 00010000:00010000:0.0:1789351250.144417:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df747a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e2b expref: 16 pid: 5824 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351250.144473:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:0.0:1789351250.144486:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+16:2348:x1876270616991872:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351250.144513:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351250.144521:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df747a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e2b expref: 16 pid: 5824 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.144537:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df747a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e2b expref: 16 pid: 5824 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.144565:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:0.0:1789351250.144571:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df74c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.144583:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df74c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.144590:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df74c0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.144631:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351250.144711:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+16:2348:x1876270616991872:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 227us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351250.144719:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 58 00010000:00010000:3.0:1789351250.145740:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df747a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e2b expref: 15 pid: 5824 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351250.145768:0:9467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9467:1876270626429056:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351250.145801:0:9467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df74c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.145811:0:9467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df74c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.145817:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df74c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.145858:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df74c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.145879:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df74c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.145886:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df74c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.145893:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351250.145898:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df74c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.145906:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df74c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.145921:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:3.0:1789351250.145924:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789351250.145928:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df74c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.145935:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df74c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351250.146020:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+14:10526:x1876270616991744:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 Request processed in 6026us (6212us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789351250.146029:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 126 00000100:00100000:1.0:1789351250.148515:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351250.148561:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616992000 00000100:00100000:3.0:1789351250.148575:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616992000 00000100:00100000:3.0:1789351250.148725:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:3.0:1789351250.148740:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270616992000:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789351250.148802:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c7cc43e4/0xa6ea017771df74c7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.148843:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df74a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e47 expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.148854:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351250.148860:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789351250.148866:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7cc43e4/0xa6ea017771df74c7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.148911:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df74a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e47 expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.148927:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df74a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e47 expref: 7 pid: 6661 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351250.148946:0:6661:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6661:1876270626429184:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351250.149059:0:6661:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc65cee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789351250.153313:0:6661:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6661:1876270626429184:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351250.153355:0:6661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c7cc43e4/0xa6ea017771df74c7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351250.154645:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351250.154985:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616992128 00000100:00100000:2.0:1789351250.154996:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616992128 00010000:00010000:2.0:1789351250.155039:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df74a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e47 expref: 8 pid: 6661 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351250.155118:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:2.0:1789351250.155127:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+8:2347:x1876270616992128:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789351250.155145:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351250.155170:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df74a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e47 expref: 8 pid: 6661 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.155203:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df74a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e47 expref: 8 pid: 6661 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.155229:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df74a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e47 expref: 8 pid: 6661 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.155246:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789351250.155262:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789351250.155270:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7cc43e4/0xa6ea017771df74c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.155284:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7cc43e4/0xa6ea017771df74c7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.155318:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351250.155351:0:6661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c7cc43e4/0xa6ea017771df74c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.155387:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7cc43e4/0xa6ea017771df74c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.155419:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c7cc43e4/0xa6ea017771df74c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.155441:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7cc43e4/0xa6ea017771df74c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.155450:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7cc43e4/0xa6ea017771df74c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.155458:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104600 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351250.155463:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7cc43e4/0xa6ea017771df74c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.155473:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7cc43e4/0xa6ea017771df74c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351250.155548:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270616992128:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 312us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351250.155558:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00010000:00010000:3.0:1789351250.155799:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7cc43e4/0xa6ea017771df74c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.155810:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7cc43e4/0xa6ea017771df74c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351250.155879:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:2347:x1876270616992000:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 7143us (7376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351250.155887:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:1.0:1789351250.157202:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351250.157271:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616992384 00000100:00100000:2.0:1789351250.157279:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616992384 00000100:00100000:2.0:1789351250.157332:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 127 00000100:00100000:2.0:1789351250.157342:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+14:10526:x1876270616992384:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789351250.157522:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df74ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.157544:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df74ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.157562:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df74ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.157893:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df74d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.157904:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7488 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e32 expref: 15 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.157912:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df74d5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.157969:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7488 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e32 expref: 15 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.157986:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7488 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e32 expref: 15 pid: 9467 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351250.158003:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626429312:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351250.158090:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2c4ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789351250.161590:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626429312:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351250.161631:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df74d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351250.161658:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351250.161707:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616992512 00000100:00100000:2.0:1789351250.161714:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616992512 00010000:00010000:2.0:1789351250.161758:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7488 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e32 expref: 16 pid: 9467 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351250.161815:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:2.0:1789351250.161826:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+16:2348:x1876270616992512:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789351250.161846:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351250.161854:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7488 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e32 expref: 16 pid: 9467 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.161868:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7488 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e32 expref: 16 pid: 9467 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.161897:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7488 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e32 expref: 16 pid: 9467 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.161917:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:2.0:1789351250.161923:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df74d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.161933:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df74d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.161941:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df74d5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.161966:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351250.162003:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df74d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.162022:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df74d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351250.162034:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+15:2348:x1876270616992512:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 210us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351250.162041:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00000001:00080000:2.0:1789351250.162952:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1789351250.163115:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1789351250.163149:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1789351250.163349:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1876270626429440:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789351250.163446:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351250.163537:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2c4c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789351250.163626:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626429440 00000100:00100000:1.0:1789351250.163634:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626429440 00000100:00100000:1.0:1789351250.163838:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789351250.163850:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5824:x1876270626429440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789351250.163952:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5824:x1876270626429440:12345-0@lo:1000:mdt00_002.0 Request processed in 104us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351250.163959:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789351250.164021:0:5824:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1789351250.164028:0:5824:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2cf9d44e00, transno 4294967303 00000004:00080000:2.0:1789351250.164051:0:5824:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1789351250.164072:0:5824:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2cc31d0000, transno 4294967309 00000100:00100000:2.0:1789351250.164081:0:5824:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8d2cc31d1c00 x1876270626428672/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789351266 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351250.164095:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1876270626429440:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789351250.164556:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1789351250.164609:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1876270626429568:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789351250.164644:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351250.164945:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2c4ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789351250.165068:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626429568 00000100:00100000:0.0:1789351250.165074:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626429568 00000100:00100000:0.0:1789351250.165100:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789351250.165106:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5824:x1876270626429568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789351250.165472:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5824:x1876270626429568:12345-0@lo:1000:mdt00_002.0 Request processed in 364us (826us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789351250.165480:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789351250.165598:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1876270626429568:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789351250.165635:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df74d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.165643:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df74d5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.165650:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df74d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.165654:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351250.165753:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df74d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.165772:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df74d5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.165790:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:2.0:1789351250.165793:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789351250.165798:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df74d5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.165802:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df74d5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.165832:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7418 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.165838:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7418 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.165844:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7418 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.165850:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351250.165853:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7418 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.165859:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7418 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.165867:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:2.0:1789351250.165869:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789351250.165878:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df741f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e16 expref: 18 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.165902:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df741f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e16 expref: 18 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.165912:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df741f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e16 expref: 18 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.165947:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df741f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e16 expref: 18 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351250.165961:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626429696:192.168.201.52@tcp:105: 00000100:00100000:2.0:1789351250.166087:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2c4ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789351250.169772:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626429696:192.168.201.52@tcp:105: 00010000:00010000:2.0:1789351250.169814:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7418 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351250.169876:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351250.169934:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616992640 00010000:00010000:2.0:1789351250.169938:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7418 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351250.169943:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616992640 00010000:00010000:2.0:1789351250.169978:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df74dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.169996:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df74dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.170015:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df74dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.170029:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df74dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.170054:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df74dc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351250.170056:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00010000:00010000:2.0:1789351250.170060:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df74dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.170067:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1200 already unused, calling callback (ffffffffc211b4f0) 00000100:00100000:3.0:1789351250.170068:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+19:10525:x1876270616992640:12345-192.168.201.52@tcp:49:lfs.0 00010000:00010000:2.0:1789351250.170072:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df74dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.170079:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df74dc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.170092:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:2.0:1789351250.170094:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351250.170098:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df74dc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.170103:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df74dc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.170113:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df74ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.170118:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df74ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.170124:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df74ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.170128:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351250.170137:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df74ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.170143:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df74ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351250.170240:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+19:10525:x1876270616992640:12345-192.168.201.52@tcp:49:lfs.0 Request processed in 172us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351250.170248:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00010000:00010000:2.0:1789351250.171637:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:2.0:1789351250.171647:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789351250.171656:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df74ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.171676:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df74ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351250.173459:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351250.173527:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616992896 00000100:00100000:3.0:1789351250.173540:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616992896 00000100:00100000:3.0:1789351250.173609:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 128 00000100:00100000:3.0:1789351250.173622:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+19:10525:x1876270616992896:12345-192.168.201.52@tcp:58:lfs.0 00000100:00100000:2.0:1789351250.173907:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+19:10526:x1876270616992384:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 16563us (16706us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1789351250.173917:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 127 00000020:00080000:2.0:1789351250.173923:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789351250.174063:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789351250.174108:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+18:10525:x1876270616992896:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 490us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351250.174115:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 128 00000040:00080000:0.0:1789351250.174487:0:11642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789351250.174493:0:11642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789351250.174534:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789351250.174540:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789351250.174666:0:11642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf95fc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11642:1876270626429824:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789351250.174745:0:11642:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0c0f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789351250.176244:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351250.176323:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616993152 00000100:00100000:2.0:1789351250.176333:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616993152 00000100:00100000:2.0:1789351250.176413:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:2.0:1789351250.176426:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf03a1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+19:10526:x1876270616993152:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789351250.177314:0:5826:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789351250.177494:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1789351250.177548:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df74e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.177567:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df74e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.177581:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df74e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.177599:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df74e3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.177606:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df74e3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.177613:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df74e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.177636:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789351250.181553:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf03a1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+21:10526:x1876270616993152:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 5106us (5293us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789351250.181591:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000020:00080000:2.0:1789351250.181612:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789351250.181759:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351250.181773:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df74e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.181790:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1800 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351250.181797:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df74e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.181814:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df74e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.181848:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351250.181855:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789351250.181862:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df74e3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.181892:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df74e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351250.181920:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351250.181923:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351250.181925:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351250.182245:0:11642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf95fc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11642:1876270626429824:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789351250.182537:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351250.183466:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616993280 00000100:00100000:3.0:1789351250.183479:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616993280 00000100:00100000:3.0:1789351250.183582:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 129 00000100:00100000:3.0:1789351250.183593:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf95fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+20:10527:x1876270616993280:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789351250.183633:0:9467:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789351250.183777:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf95fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+20:10527:x1876270616993280:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 184us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351250.183801:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 129 00000100:00100000:0.0:1789351250.186573:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351250.186643:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616993536 00000100:00100000:1.0:1789351250.186659:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616993536 00000100:00100000:1.0:1789351250.186741:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 130 00000100:00100000:1.0:1789351250.186754:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+20:10527:x1876270616993536:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789351250.186786:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351250.186814:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df74ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e4e expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.186955:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df74f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.186974:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df74f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.186987:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df74f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351250.187001:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789351250.187210:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df74ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e4e expref: 23 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.187232:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df74f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e4e expref: 22 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351250.187242:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:1.0:1789351250.187246:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789351250.187262:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4000, rc 0) 00000100:00100000:1.0:1789351250.187343:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+22:10527:x1876270616993536:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 591us (783us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1789351250.187351:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 130 00000100:00100000:1.0:1789351250.200411:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351250.200499:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616993792 00000100:00100000:3.0:1789351250.200512:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616993792 00000100:00100000:3.0:1789351250.200573:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 131 00000100:00100000:3.0:1789351250.200581:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+22:10527:x1876270616993792:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789351250.200694:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df74ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.200711:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df74ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.200722:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df74ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.201009:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df74ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.201018:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df74ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.201025:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df74ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.201032:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351250.201037:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df74ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.201046:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df74ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.201074:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:3.0:1789351250.201078:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789351250.201083:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df74ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.201090:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df74ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351250.201281:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+23:10527:x1876270616993792:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 699us (884us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789351250.201288:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 131 00000040:00080000:0.0:1789351250.201943:0:11642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789351250.201949:0:11642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789351250.203235:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789351250.203259:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789351250.206901:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351250.206968:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616993920 00000100:00100000:3.0:1789351250.206983:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616993920 00000100:00100000:2.0:1789351250.207031:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351250.207126:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 132 00000100:00100000:3.0:1789351250.207139:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+23:10529:x1876270616993920:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351250.207167:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351250.207193:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7506 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e55 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351250.207285:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616994176 00000100:00100000:0.0:1789351250.207291:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616994176 00010000:00010000:3.0:1789351250.207334:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df750d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351250.207340:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:0.0:1789351250.207354:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+25:10527:x1876270616994176:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00010000:00010000:3.0:1789351250.207379:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df750d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.207394:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df750d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.207419:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7514 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.207434:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.207441:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351250.207673:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+26:10527:x1876270616994176:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 323us (641us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789351250.207679:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00010000:00010000:3.0:1789351250.207811:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df751b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.207823:0:9467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e0f expref: 25 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.207831:0:9467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df751b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.207875:0:9467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e0f expref: 25 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.207890:0:9467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e0f expref: 25 pid: 5824 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351250.207948:0:9467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc77800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9467:1876270626429952:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351250.208050:0:9467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cffa71900 going to sleep for 11 seconds 00000100:00100000:0.0:1789351250.214455:0:9467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc77800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9467:1876270626429952:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789351250.214495:0:9467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df751b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351250.216737:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351250.217005:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616994432 00000100:00100000:2.0:1789351250.217018:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616994432 00000100:00100000:2.0:1789351250.217092:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:2.0:1789351250.217105:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+26:5580:x1876270616994432:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789351250.217466:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+27:5580:x1876270616994432:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 362us (739us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789351250.217474:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:2.0:1789351250.222458:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351250.222775:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616994560 00000100:00100000:0.0:1789351250.222788:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616994560 00010000:00010000:0.0:1789351250.222845:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e0f expref: 27 pid: 5824 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351250.222899:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:0.0:1789351250.222913:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+27:2347:x1876270616994560:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351250.222933:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351250.222942:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e0f expref: 27 pid: 5824 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.222959:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e0f expref: 27 pid: 5824 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.222990:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df740a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e0f expref: 27 pid: 5824 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.223012:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:0.0:1789351250.223048:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df751b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.223060:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df751b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.223068:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df751b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351250.223109:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351250.223177:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+26:2347:x1876270616994560:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 267us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351250.223186:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 61 00010000:00010000:3.0:1789351250.223495:0:9467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df751b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.223505:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df751b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351250.223578:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789351250.223583:0:9467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351250.223610:0:9467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df751b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.223625:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df751b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.223637:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df750d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.223644:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df750d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.223652:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df750d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.223659:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351250.223663:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df750d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.223671:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df750d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.223682:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:3.0:1789351250.223685:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351250.223690:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df750d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.226532:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df750d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.226592:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.226600:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7514 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.226607:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.226614:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351250.226619:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.226627:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7514 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.226646:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d2ce058f300) 00010000:00010000:3.0:1789351250.226649:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351250.226655:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7514 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.226662:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7514 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.226729:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7506 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e55 expref: 26 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.226746:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df751b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e55 expref: 25 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351250.226767:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:3.0:1789351250.226769:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789351250.226773:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105a00, rc 0) 00000100:00100000:3.0:1789351250.226928:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+25:10529:x1876270616993920:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 19789us (20040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351250.226938:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 132 00010000:00010000:1.0:1789351250.914205:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789351250.970661:0:12015:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789351250.970673:0:12015:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789351250.970723:0:12015:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789351250.970730:0:12015:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789351251.093627:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351251.093727:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616994816 00000100:00100000:1.0:1789351251.093742:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616994816 00000100:00100000:1.0:1789351251.093814:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 133 00000100:00100000:1.0:1789351251.093827:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+25:10552:x1876270616994816:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789351251.093859:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351251.093887:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df7522 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e5c expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351251.094013:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7529 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351251.094042:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7529 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351251.094055:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7529 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351251.094069:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789351251.094255:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5000/0xa6ea017771df7522 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e5c expref: 28 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351251.094276:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7529 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e5c expref: 27 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351251.094287:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:1.0:1789351251.094290:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789351251.094296:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4600, rc 0) 00000100:00100000:1.0:1789351251.094786:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+27:10552:x1876270616994816:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 960us (1174us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789351251.094795:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 133 00000100:00100000:0.0:1789351251.098232:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351251.098293:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616994944 00000100:00100000:3.0:1789351251.098304:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616994944 00000100:00100000:0.0:1789351251.098428:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 134 00000100:00100000:0.0:1789351251.098444:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+27:10552:x1876270616994944:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:0.0:1789351251.098533:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7537 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351251.098553:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351251.098567:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351251.098601:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351251.098608:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7537 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351251.098627:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351251.098634:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351251.098639:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351251.098648:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7537 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351251.098662:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:0.0:1789351251.098665:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789351251.098671:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7537 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351251.098678:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7537 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351251.098765:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+27:10552:x1876270616994944:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 325us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351251.098775:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 134 00000100:00100000:0.0:1789351251.156858:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351251.157028:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616995072 00000100:00100000:1.0:1789351251.157042:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616995072 00000100:00100000:1.0:1789351251.157116:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:1.0:1789351251.157130:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+6:2349:x1876270616995072:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:1.0:1789351251.157157:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351251.157186:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1d17c94/0xa6ea017771df753e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e63 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789351251.157257:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa75551, atime: 0x6aa75550, ctime: 0x6aa75551, blocks: 0xb 00010000:00010000:1.0:1789351251.157286:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=195s v=(0 0) 00010000:00010000:1.0:1789351251.157292:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789351251.157304:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1d17c94/0xa6ea017771df753e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e63 expref: 7 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351251.157329:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d1d17c94/0xa6ea017771df753e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e63 expref: 7 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351251.157346:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5000, rc 0) 00000100:00100000:1.0:1789351251.157466:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+7:2349:x1876270616995072:12345-192.168.201.52@tcp:101:cat.0 Request processed in 339us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351251.157472:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:3.0:1789351251.161290:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351251.161677:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616995200 00000100:00100000:2.0:1789351251.161690:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616995200 00002000:00100000:2.0:1789351251.161769:0:6666:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8d2cffc76d80 x1876270616995200/t0(0) o3->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:507/0 lens 488/0 e 0 to 0 dl 1789351262 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789351251.161782:0:6666:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cffc76d80 with x1876270616995200 ext(0->4095) 00002000:00010000:2.0:1789351251.161789:0:6666:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2cffc76d80 00000100:00100000:2.0:1789351251.161836:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:2.0:1789351251.161848:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8237986d-b9e8-417a-ac8f-a078390d268c+7:2348:x1876270616995200:12345-192.168.201.52@tcp:3:cat.0 00000100:00100000:2.0:1789351251.162319:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8237986d-b9e8-417a-ac8f-a078390d268c+7:2348:x1876270616995200:12345-192.168.201.52@tcp:3:cat.0 Request processed in 472us (1045us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789351251.162336:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00002000:00100000:2.0:1789351251.162344:0:6666:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8d2cffc76d80 x1876270616995200/t0(0) o3->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:507/0 lens 488/4536 e 0 to 0 dl 1789351262 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789351251.162354:0:6666:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cffc76d80 with x1876270616995200 ext(0->4095) 00002000:00010000:2.0:1789351251.162413:0:6666:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2cffc76d80 00000100:00100000:0.0:1789351251.621600:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626430464:0@lo:400:kworker.0 00000100:00100000:0.0:1789351251.621704:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351251.621782:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789351251.621790:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626430080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789351251.621820:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351251.621847:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626430592:0@lo:400:kworker.0 00000100:00100000:0.0:1789351251.621885:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351251.621925:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626430208:0@lo:400:kworker.0 00000100:00100000:0.0:1789351251.621965:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351251.621984:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626430464 00000100:00100000:3.0:1789351251.621993:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626430464 00000100:00100000:0.0:1789351251.621995:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876270626430720:0@lo:400:kworker.0 00000100:00100000:0.0:1789351251.622022:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351251.622047:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789351251.622054:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626430336:0@lo:400:kworker.0 00000100:00100000:3.0:1789351251.622059:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626430720 00000100:00100000:3.0:1789351251.622062:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626430720 00000100:00100000:0.0:1789351251.622084:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351251.622087:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789351251.622098:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626430464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351251.622108:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626430848:0@lo:400:kworker.0 00000100:00100000:0.0:1789351251.622164:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351251.622209:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626430464:12345-0@lo:400:kworker.0 Request processed in 113us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351251.622216:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789351251.622241:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626430336 00000100:00100000:3.0:1789351251.622244:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626430336 00000100:00100000:3.0:1789351251.622254:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789351251.622258:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876270626430720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351251.622280:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876270626430720:12345-0@lo:400:kworker.0 Request processed in 22us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351251.622284:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789351251.622298:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789351251.622307:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626430336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351251.622331:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626430336:12345-0@lo:400:kworker.0 Request processed in 29us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351251.622336:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789351251.622463:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789351251.622496:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876270626430720:0@lo:400:kworker.0 00000100:00100000:3.0:1789351251.622499:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626430464:0@lo:400:kworker.0 00000100:00100000:0.0:1789351251.622528:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626430336:0@lo:400:kworker.0 00000100:00100000:0.0:1789351251.622559:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626430080 00000100:00100000:0.0:1789351251.622562:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626430080 00000100:00100000:0.0:1789351251.623688:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789351251.623704:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1876270626430080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789351251.623744:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789351251.623815:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1876270626430080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (1994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351251.623823:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789351251.626411:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626430592 00000100:00100000:0.0:1789351251.626431:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626430592 00000100:00100000:0.0:1789351251.626510:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626430848 00000100:00100000:0.0:1789351251.626514:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626430848 00000100:00100000:0.0:1789351251.626548:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789351251.626561:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3288:x1876270626430592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351251.626641:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789351251.626663:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3286:x1876270626430848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351251.626782:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3286:x1876270626430848:12345-0@lo:400:kworker.0 Request processed in 120us (4616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351251.626788:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3288:x1876270626430592:12345-0@lo:400:kworker.0 Request processed in 229us (4900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351251.626795:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789351251.626867:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626430848:0@lo:400:kworker.0 00000100:00100000:3.0:1789351251.626947:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626430080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789351251.626987:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626430592:0@lo:400:kworker.0 00000100:00100000:0.0:1789351251.627755:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789351251.627798:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626430208 00000100:00100000:0.0:1789351251.627804:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626430208 00000100:00100000:0.0:1789351251.627847:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789351251.627858:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8339450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3286:x1876270626430208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351251.627925:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8339450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3286:x1876270626430208:12345-0@lo:400:kworker.0 Request processed in 69us (5960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351251.627932:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789351251.628010:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626430208:0@lo:400:kworker.0 00000001:00080000:1.0:1789351251.664561:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1789351251.664583:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1789351251.665587:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:1.0:1789351251.888631:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351251.888939:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351251.888984:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351251.889007:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351251.889029:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351251.889076:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616995840 00000100:00100000:1.0:1789351251.889089:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616995840 00000100:00080000:3.0:1789351251.889162:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789351251.889181:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616995456 00000100:00100000:1.0:1789351251.889186:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616995456 00000100:00100000:3.0:1789351251.889191:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:1.0:1789351251.889214:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:3.0:1789351251.889233:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2347:x1876270616995840:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789351251.889246:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+27:2347:x1876270616995456:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351251.889331:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616995584 00000100:00100000:0.0:1789351251.889335:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616995584 00000100:00100000:0.0:1789351251.889411:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616995712 00000100:00100000:0.0:1789351251.889418:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616995712 00000100:00100000:0.0:1789351251.889482:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:0.0:1789351251.889489:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+5:2347:x1876270616995584:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351251.889548:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2347:x1876270616995840:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 343us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351251.889558:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:2.0:1789351251.889567:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616995328 00000100:00100000:2.0:1789351251.889573:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616995328 00000100:00100000:3.0:1789351251.889611:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:2.0:1789351251.889618:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 260 00000100:00100000:3.0:1789351251.889623:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270616995712:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351251.889632:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2347:x1876270616995328:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789351251.890174:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+27:2347:x1876270616995456:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 930us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351251.890176:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270616995712:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 555us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351251.890185:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:3.0:1789351251.890279:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:2.0:1789351251.890566:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2347:x1876270616995328:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 936us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351251.890576:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 260 00000100:00080000:1.0:1789351251.890878:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789351251.891387:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+5:2347:x1876270616995584:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 1893us (2443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351251.891399:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00010000:00010000:1.0:1789351251.937776:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351252.961937:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789351253.281634:0:11642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789351253.281642:0:11642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789351253.281674:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789351253.281680:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789351253.985847:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351254.197073:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351254.197174:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616995968 00000100:00100000:0.0:1789351254.197194:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616995968 00000100:00100000:0.0:1789351254.197283:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 135 00000100:00100000:0.0:1789351254.197294:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+27:10214:x1876270616995968:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789351254.197460:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+27:10214:x1876270616995968:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 Request processed in 168us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351254.197468:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 135 00000100:00080000:1.0:1789351254.197676:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351254.199656:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351254.200263:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616996224 00000100:00100000:1.0:1789351254.200275:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616996224 00000100:00100000:1.0:1789351254.200328:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:1.0:1789351254.200338:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+27:10214:x1876270616996224:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789351254.200764:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+28:10214:x1876270616996224:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 426us (1120us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789351254.200772:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:2.0:1789351254.326546:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351254.326630:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616996352 00000100:00100000:1.0:1789351254.326644:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616996352 00000100:00100000:1.0:1789351254.326753:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 136 00000100:00100000:1.0:1789351254.326767:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:11003:x1876270616996352:12345-192.168.201.52@tcp:101:lsof.0 00000100:00080000:3.0:1789351254.326793:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789351254.326796:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351254.326826:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5a00/0xa6ea017771df7545 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e6a expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351254.326906:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df754c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351254.326920:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df754c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351254.326949:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df754c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351254.327438:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789351254.327442:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789351254.327531:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df754c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351254.327562:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5a00/0xa6ea017771df7545 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e6a expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351254.327580:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df754c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e6a expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351254.327588:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a200) 00010000:00010000:1.0:1789351254.327590:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789351254.327594:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4e00, rc 0) 00000100:00100000:1.0:1789351254.327677:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+6:11003:x1876270616996352:12345-192.168.201.52@tcp:101:lsof.0 Request processed in 913us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351254.327684:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 136 00000100:00100000:2.0:1789351254.690154:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789351254.690198:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd827d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626430976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789351254.690304:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351254.691126:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626430976 00000100:00100000:3.0:1789351254.691140:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626430976 00000100:00080000:0.0:1789351254.691223:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789351254.691242:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789351254.691255:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626430976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789351254.691304:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789351254.691429:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626430976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 176us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351254.691542:0:3289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789351254.691550:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:2.0:1789351254.691579:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2cc31d3100, transno 4294967301 00000004:00080000:2.0:1789351254.691596:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1789351254.691611:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2cffc7dc00, transno 4294967304 00000100:00100000:2.0:1789351254.691626:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd827d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626430976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789351254.698189:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1789351255.010805:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789351255.261561:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1789351255.261582:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1789351255.268073:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:1.0:1789351255.268098:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1789351255.268110:0:5844:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1789351255.268146:0:5844:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2cc2c4c180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789351255.268152:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d2ce9d9df00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2cc2c4c480 00000020:00080000:1.0:1789351255.268156:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d2ce9d9db00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2cf9cbb400 00000020:00080000:0.0:1789351255.268210:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789351255.268500:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1789351256.035395:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789351256.736255:0:12216:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:00:55 (1789351255) 00000100:00100000:3.0:1789351256.738554:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789351256.738577:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626431104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789351256.738646:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351256.738716:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626431104 00000100:00100000:3.0:1789351256.738724:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626431104 00000100:00100000:3.0:1789351256.738772:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789351256.738783:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626431104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789351256.738818:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789351256.738863:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626431104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351256.738870:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1789351256.738889:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789351256.738918:0:3288:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1789351256.738924:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2cc31d1c00, transno 4294967310 00000004:00080000:3.0:1789351256.738947:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1789351256.738971:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626431104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789351256.739784:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876270626431360:0@lo:400:kworker.0 00000100:00100000:3.0:1789351256.739824:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351256.739849:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789351256.739855:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626431232:0@lo:400:kworker.0 00000100:00100000:3.0:1789351256.739882:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351256.739907:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876270626431744:0@lo:400:kworker.0 00000100:00100000:3.0:1789351256.739928:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351256.739953:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626431360 00000100:00100000:3.0:1789351256.739958:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626431360 00000100:00100000:3.0:1789351256.739989:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626431744 00000100:00100000:3.0:1789351256.739992:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626431744 00000100:00100000:3.0:1789351256.740015:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789351256.740022:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876270626431360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351256.740061:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876270626431360:12345-0@lo:400:kworker.0 Request processed in 39us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351256.740068:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789351256.740080:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789351256.740086:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876270626431744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351256.740111:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876270626431744:12345-0@lo:400:kworker.0 Request processed in 26us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351256.740117:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789351256.740134:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626431232 00000100:00100000:3.0:1789351256.740137:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626431232 00000100:00100000:3.0:1789351256.740175:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789351256.740182:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3287:x1876270626431232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351256.740219:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3287:x1876270626431232:12345-0@lo:400:kworker.0 Request processed in 38us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351256.740225:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789351256.740265:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626431616:0@lo:400:kworker.0 00000100:00100000:3.0:1789351256.740291:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351256.740312:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789351256.740317:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876270626431488:0@lo:400:kworker.0 00000100:00100000:3.0:1789351256.740338:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351256.740465:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626431616 00000100:00100000:3.0:1789351256.740470:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626431616 00000100:00100000:3.0:1789351256.740502:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789351256.740508:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626431616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351256.740541:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626431616:12345-0@lo:400:kworker.0 Request processed in 34us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351256.740547:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789351256.740564:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626431488 00000100:00100000:3.0:1789351256.740567:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626431488 00000100:00100000:3.0:1789351256.740589:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789351256.740594:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876270626431488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351256.740622:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876270626431488:12345-0@lo:400:kworker.0 Request processed in 28us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351256.740627:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1789351256.740645:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789351256.740649:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351256.740671:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876270626431488:0@lo:400:kworker.0 00000100:00100000:3.0:1789351256.740680:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626431616:0@lo:400:kworker.0 00000100:00100000:3.0:1789351256.740716:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626431232:0@lo:400:kworker.0 00000100:00100000:3.0:1789351256.740727:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876270626431744:0@lo:400:kworker.0 00000100:00100000:3.0:1789351256.740735:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876270626431360:0@lo:400:kworker.0 00000100:00100000:3.0:1789351257.010895:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351257.011029:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351257.011078:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351257.011118:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351257.011162:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351257.011203:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616996992 00000100:00100000:3.0:1789351257.011216:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616996992 00000100:00100000:3.0:1789351257.011301:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616996608 00000100:00100000:3.0:1789351257.011457:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616996608 00000100:00100000:3.0:1789351257.011490:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:3.0:1789351257.011502:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+6:2348:x1876270616996992:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351257.011598:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+6:2348:x1876270616996992:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 98us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351257.011606:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:3.0:1789351257.011624:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:3.0:1789351257.011630:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+14:2348:x1876270616996608:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351257.011659:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+14:2348:x1876270616996608:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 29us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351257.011664:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:3.0:1789351257.011684:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616996736 00000100:00100000:3.0:1789351257.011688:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616996736 00000100:00100000:3.0:1789351257.011730:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616996864 00000100:00100000:3.0:1789351257.011733:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616996864 00000100:00100000:3.0:1789351257.011754:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:3.0:1789351257.011871:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cefce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+5:2348:x1876270616996736:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351257.011901:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cefce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+5:2348:x1876270616996736:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 141us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351257.011908:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:3.0:1789351257.012070:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:3.0:1789351257.012077:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:2348:x1876270616996864:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351257.012102:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:2348:x1876270616996864:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 26us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351257.012108:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00080000:3.0:1789351257.012127:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789351257.012132:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789351257.012134:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789351257.014831:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616996480 00000100:00100000:2.0:1789351257.014851:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616996480 00000100:00100000:1.0:1789351257.015026:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 262 00000100:00100000:1.0:1789351257.015039:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2348:x1876270616996480:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789351257.015189:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2348:x1876270616996480:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 152us (4312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351257.015199:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 262 00010000:00010000:3.0:1789351257.058249:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351257.540771:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351257.541178:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616997248 00000100:00100000:0.0:1789351257.541193:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616997248 00000100:00100000:0.0:1789351257.541288:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 137 00000100:00100000:0.0:1789351257.541302:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+14:11268:x1876270616997248:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789351257.541331:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351257.541392:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7553 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e71 expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.541497:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df755a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.541514:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df755a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.541528:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df755a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.541545:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7561 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.541553:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7561 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.541582:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7561 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542121:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7568 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542141:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7568 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542151:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7568 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351257.542164:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789351257.542419:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df755a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542427:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df755a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542435:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df755a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542441:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351257.542446:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df755a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542455:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df755a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542469:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2ce058fe00) 00010000:00010000:0.0:1789351257.542472:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351257.542483:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df755a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542490:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df755a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542508:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7561 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542515:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7561 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542520:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7561 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542525:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351257.542528:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7561 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542534:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7561 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542542:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d2cc886ed00) 00010000:00010000:0.0:1789351257.542545:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351257.542548:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7561 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542554:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7561 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.542966:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7553 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e71 expref: 17 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.543000:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7568 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e71 expref: 16 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.543009:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2cc3d1c800) 00010000:00010000:0.0:1789351257.543012:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351257.543015:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0030800, rc 0) 00000100:00100000:0.0:1789351257.543114:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+16:11268:x1876270616997248:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1814us (2356us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789351257.543124:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 137 00000100:00100000:2.0:1789351257.549112:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351257.549178:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351257.549190:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616997376 00000100:00100000:3.0:1789351257.549325:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616997376 00000100:00100000:3.0:1789351257.549540:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 138 00000100:00100000:3.0:1789351257.549554:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+16:11268:x1876270616997376:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789351257.549637:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616997504 00000100:00100000:0.0:1789351257.549644:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616997504 00000100:00100000:3.0:1789351257.549699:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+17:11268:x1876270616997376:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 Request processed in 148us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351257.549709:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 138 00000100:00100000:0.0:1789351257.549746:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:0.0:1789351257.549755:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6581c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+16:2348:x1876270616997504:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351257.549769:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351257.549802:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df7568 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e71 expref: 16 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351257.549828:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2cc3d1c800) 00010000:00010000:0.0:1789351257.549834:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351257.549857:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6581c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+15:2348:x1876270616997504:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 105us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351257.549865:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00010000:00010000:3.0:1789351258.081631:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789351258.403773:0:11642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789351258.403796:0:11642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789351258.404326:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789351258.404337:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789351258.971563:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351258.971629:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616997632 00000100:00100000:1.0:1789351258.971646:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616997632 00000100:00100000:1.0:1789351258.971729:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 139 00000100:00100000:1.0:1789351258.971744:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+15:11310:x1876270616997632:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789351258.971776:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351258.971807:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df7576 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e78 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.971900:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df757d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.971919:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df757d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.971937:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df757d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.971956:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7584 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.971965:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.971985:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972412:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df757d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972422:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df757d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972430:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df757d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972437:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351258.972442:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df757d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972452:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df757d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972467:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a200) 00010000:00010000:1.0:1789351258.972471:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351258.972478:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df757d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972486:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df757d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972501:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972508:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7584 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972520:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7584 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972526:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351258.972529:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7584 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972535:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7584 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972543:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d2cc3d1c700) 00010000:00010000:1.0:1789351258.972546:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351258.972549:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7584 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972556:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7584 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972602:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df7576 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e78 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972614:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a200) 00010000:00010000:1.0:1789351258.972616:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351258.972620:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df7576 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e78 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.972630:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4200, rc 0) 00000100:00100000:1.0:1789351258.972723:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+15:11310:x1876270616997632:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 983us (1169us total) trans 0 rc 301/301 00000100:00100000:1.0:1789351258.972741:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 139 00000100:00100000:1.0:1789351258.978095:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351258.978203:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616997888 00000100:00100000:0.0:1789351258.978218:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616997888 00000100:00100000:0.0:1789351258.978298:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 140 00000100:00100000:0.0:1789351258.978322:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+15:11310:x1876270616997888:12345-192.168.201.52@tcp:36:lfs.0 00010000:00010000:0.0:1789351258.978436:0:10562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351258.978474:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df6eed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7caa expref: 15 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351258.978496:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a200) 00010000:00010000:0.0:1789351258.978503:0:10562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789351258.978857:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df758b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351258.978877:0:10562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df754c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e6a expref: 5 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351258.978888:0:10562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df758b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351258.978929:0:10562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df754c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e6a expref: 5 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351258.978946:0:10562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df754c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e6a expref: 5 pid: 5823 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351258.978965:0:10562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd827df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10562:1876270626431872:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789351258.979165:0:10562:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc5e2f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789351258.987304:0:10562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd827df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10562:1876270626431872:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351258.987478:0:10562:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df758b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351258.987766:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351258.987841:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616998016 00000100:00100000:2.0:1789351258.987851:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616998016 00010000:00010000:2.0:1789351258.987907:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df754c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e6a expref: 6 pid: 5823 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351258.987949:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:2.0:1789351258.987960:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+6:2347:x1876270616998016:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789351258.987979:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351258.987987:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df754c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e6a expref: 6 pid: 5823 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351258.988006:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df754c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e6a expref: 6 pid: 5823 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351258.988038:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df754c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e6a expref: 6 pid: 5823 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351258.988074:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a200) 00010000:00010000:2.0:1789351258.988081:0:6676:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df758b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351258.988093:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df758b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351258.988102:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df758b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351258.988140:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789351258.988208:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2347:x1876270616998016:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 248us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351258.988216:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 62 00010000:00010000:0.0:1789351258.988585:0:10562:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df758b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351258.988595:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df758b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351258.988635:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7592 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351258.988646:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7592 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351258.988654:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7592 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351258.990056:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1789351258.990076:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df758b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351258.990088:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df758b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351258.990097:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df758b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351258.990105:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351258.990122:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df758b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351258.990133:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df758b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351258.990150:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2ce9e1a200) 00010000:00010000:0.0:1789351258.990154:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351258.990159:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df758b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351258.990177:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df758b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789351258.990202:0:10562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000116dc62f reply state 000000005447cf34 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7592 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351258.990212:0:10562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789351258.990330:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+16:11310:x1876270616997888:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 12007us (12242us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789351258.990341:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 140 00010000:00010000:1.0:1789351258.998396:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7592 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.998430:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7592 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.998441:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7592 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.998450:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351258.998456:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7592 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.998466:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7592 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.998493:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d2cc886e200) 00010000:00010000:1.0:1789351258.998497:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351258.998504:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7592 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351258.998513:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df7592 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351259.067668:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351259.067787:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616998144 00000100:00100000:0.0:1789351259.067803:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616998144 00000100:00100000:0.0:1789351259.067967:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00100000:0.0:1789351259.067982:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf69f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+15:11318:x1876270616998144:12345-192.168.201.52@tcp:101:lctl.0 00010000:00010000:0.0:1789351259.068018:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351259.068054:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7599 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e7f expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.068165:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df75a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.068183:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df75a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.068199:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df75a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351259.068292:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789351259.068296:0:9467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1789351259.068389:0:9467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df75a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.068419:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df7599 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e7f expref: 17 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.068440:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df75a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e7f expref: 16 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.068449:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc886e100) 00010000:00010000:0.0:1789351259.068453:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789351259.068458:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc0030800, rc 0) 00000100:00100000:0.0:1789351259.068535:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf69f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+16:11318:x1876270616998144:12345-192.168.201.52@tcp:101:lctl.0 Request processed in 557us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351259.068542:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00080000:3.0:1789351259.068881:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789351259.105625:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351259.114939:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351259.115010:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616998272 00000100:00100000:3.0:1789351259.115024:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616998272 00000100:00100000:3.0:1789351259.115102:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00100000:3.0:1789351259.115126:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+16:11324:x1876270616998272:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789351259.115154:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351259.115181:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df75a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e86 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.115319:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df75ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.115337:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df75ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.115445:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df75ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.115465:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df75b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.115472:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df75b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.115479:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df75b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.115631:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105600/0xa6ea017771df75bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.115640:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105600/0xa6ea017771df75bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.115647:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105600/0xa6ea017771df75bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351259.116085:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1789351259.116091:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351259.116134:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105600/0xa6ea017771df75bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116148:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df75ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116155:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df75ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116161:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df75ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116168:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351259.116173:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df75ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116182:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df75ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116196:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc886e100) 00010000:00010000:3.0:1789351259.116207:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351259.116213:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df75ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116220:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df75ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116297:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df75b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116302:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df75b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116308:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df75b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116313:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351259.116316:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df75b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116321:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df75b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116330:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d2ce058f300) 00010000:00010000:3.0:1789351259.116333:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351259.116336:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df75b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116342:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df75b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116491:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df75a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e86 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116520:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105600/0xa6ea017771df75bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e86 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.116529:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:3.0:1789351259.116531:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789351259.116534:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105600, rc 0) 00000100:00100000:3.0:1789351259.116616:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+17:11324:x1876270616998272:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1494us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351259.116626:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00100000:2.0:1789351259.119270:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351259.119408:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616998528 00000100:00100000:0.0:1789351259.119421:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616998528 00000100:00100000:0.0:1789351259.119485:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 143 00000100:00100000:0.0:1789351259.119499:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+17:11324:x1876270616998528:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789351259.119526:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351259.119550:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df75c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e8d expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.119739:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df75ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.119755:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df75ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.119768:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df75ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.119802:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df75d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.119810:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df75d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.119817:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df75d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789351259.120531:0:10562:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789351259.120722:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df75d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.120735:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df75d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.120744:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df75d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.120782:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df75ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.120790:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df75ca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.120798:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df75ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.120805:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351259.120810:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df75ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.120829:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df75ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.120842:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:0.0:1789351259.120845:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351259.120851:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df75ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.120858:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030e00/0xa6ea017771df75ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789351259.120872:0:10562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008da71d74 reply state 00000000c6eea1ae transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df75d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351259.120882:0:10562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789351259.120920:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031c00/0xa6ea017771df75c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e8d expref: 20 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.120935:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df75d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e8d expref: 19 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.120942:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc886e200) 00010000:00010000:0.0:1789351259.120944:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789351259.120947:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8000, rc 0) 00000100:00100000:0.0:1789351259.121043:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+20:11324:x1876270616998528:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1546us (1785us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789351259.121052:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 143 00010000:00010000:0.0:1789351259.123769:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df75d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.123810:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df75d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.123820:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df75d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.123827:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351259.123833:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df75d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.123841:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df75d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.123862:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2cc886e700) 00010000:00010000:0.0:1789351259.123865:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351259.123871:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df75d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.123878:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031200/0xa6ea017771df75d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351259.125675:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351259.130307:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616998656 00000100:00100000:3.0:1789351259.130330:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616998656 00000100:00080000:0.0:1789351259.130533:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789351259.130629:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:3.0:1789351259.130644:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8237986d-b9e8-417a-ac8f-a078390d268c+5:2347:x1876270616998656:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789351259.130670:0:11977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351259.130696:0:11977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d190376/0xa6ea017771df75e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e94 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789351259.130731:0:11977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351259.130757:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=203s v=(0 0) 00010000:00010000:3.0:1789351259.130762:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351259.130776:0:11977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d190376/0xa6ea017771df75e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e94 expref: 6 pid: 11977 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.130799:0:11977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d190376/0xa6ea017771df75e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e94 expref: 6 pid: 11977 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.130842:0:11977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105400, rc 0) 00000100:00100000:3.0:1789351259.130948:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8237986d-b9e8-417a-ac8f-a078390d268c+6:2347:x1876270616998656:12345-192.168.201.52@tcp:101:bash.0 Request processed in 307us (5286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351259.130957:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:1.0:1789351259.137686:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351259.137757:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616998784 00000100:00100000:0.0:1789351259.137770:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616998784 00000100:00100000:0.0:1789351259.137845:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:0.0:1789351259.137860:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+6:11324:x1876270616998784:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789351259.137885:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351259.137908:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7e9b expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.137974:0:6663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d190376/0xa6ea017771df75e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e94 expref: 7 pid: 11977 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.137983:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351259.137987:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351259.137992:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e9b expref: 7 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.138026:0:6663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d190376/0xa6ea017771df75e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e94 expref: 7 pid: 11977 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.138038:0:6663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d190376/0xa6ea017771df75e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e94 expref: 7 pid: 11977 timeout: 303 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351259.138052:0:6663:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd827e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6663:1876270626432000:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789351259.138198:0:6663:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc5e2f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789351259.143175:0:6663:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd827e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6663:1876270626432000:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789351259.143231:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e9b expref: 7 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.143261:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8200, rc 0) 00000100:00100000:0.0:1789351259.143329:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+7:11324:x1876270616998784:12345-192.168.201.52@tcp:101:bash.0 Request processed in 5472us (5661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351259.143340:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:2.0:1789351259.144907:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351259.145017:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616998912 00000100:00100000:0.0:1789351259.145028:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616998912 00010000:00010000:0.0:1789351259.145077:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d190376/0xa6ea017771df75e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e94 expref: 7 pid: 11977 timeout: 303 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351259.145137:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:0.0:1789351259.145150:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+7:2348:x1876270616998912:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351259.145170:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351259.145201:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d190376/0xa6ea017771df75e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e94 expref: 7 pid: 11977 timeout: 303 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.145219:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d190376/0xa6ea017771df75e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e94 expref: 7 pid: 11977 timeout: 303 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.145258:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d190376/0xa6ea017771df75e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e94 expref: 7 pid: 11977 timeout: 303 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.145280:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351259.145286:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351259.145294:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e9b expref: 6 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.145306:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e9b expref: 6 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.145412:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e9b expref: 6 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351259.145442:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd827e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5808:1876270626432128:192.168.201.52@tcp:105: 00000100:00100000:0.0:1789351259.145546:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc5e2f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789351259.148179:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd827e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5808:1876270626432128:192.168.201.52@tcp:105: 00010000:00010000:0.0:1789351259.148219:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351259.148301:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+6:2348:x1876270616998912:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 3153us (3405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351259.148315:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:3.0:1789351259.150579:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.150726:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616999168 00000100:00100000:1.0:1789351259.150740:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616999168 00000100:00100000:1.0:1789351259.150834:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:1.0:1789351259.150847:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+19:11324:x1876270616999168:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:1.0:1789351259.151403:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+20:11324:x1876270616999168:12345-192.168.201.52@tcp:35:bash.0 Request processed in 501us (778us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789351259.151415:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:2.0:1789351259.197419:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351259.197512:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616999424 00000100:00100000:0.0:1789351259.197525:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616999424 00000100:00100000:0.0:1789351259.197606:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 144 00000100:00100000:0.0:1789351259.197619:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+20:11334:x1876270616999424:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789351259.197652:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351259.197679:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df75f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7ea2 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351259.197855:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1789351259.198022:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df75f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ea2 expref: 22 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.198040:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc886e100) 00010000:00010000:0.0:1789351259.198044:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789351259.198050:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df75f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ea2 expref: 22 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.198066:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8400, rc 0) 00000100:00100000:0.0:1789351259.198217:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+21:11334:x1876270616999424:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 600us (812us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1789351259.198225:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 144 00000100:00100000:3.0:1789351259.199917:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.200023:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616999680 00000100:00100000:1.0:1789351259.200033:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616999680 00000100:00100000:1.0:1789351259.200143:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:1.0:1789351259.200156:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+21:11334:x1876270616999680:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789351259.200456:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+22:11334:x1876270616999680:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 299us (543us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789351259.200465:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:3.0:1789351259.244620:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.244835:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270616999808 00000100:00100000:1.0:1789351259.244849:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270616999808 00000100:00100000:1.0:1789351259.244925:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 145 00000100:00100000:1.0:1789351259.244939:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+22:11340:x1876270616999808:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789351259.244971:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351259.244997:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7602 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7ea9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.245086:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7609 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.245101:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.245130:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351259.245224:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1789351259.245229:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789351259.245256:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.245288:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7602 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ea9 expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.245311:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7609 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ea9 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.245320:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:1.0:1789351259.245324:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789351259.245328:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5e00, rc 0) 00000100:00100000:1.0:1789351259.245773:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+23:11340:x1876270616999808:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 525us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351259.245783:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 145 00000100:00100000:3.0:1789351259.249806:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.249863:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617000064 00000100:00100000:1.0:1789351259.249877:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617000064 00000100:00100000:1.0:1789351259.249951:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 146 00000100:00100000:1.0:1789351259.250007:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd1622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+23:11340:x1876270617000064:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789351259.250087:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351259.250126:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df7610 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7eb0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.250272:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5a00/0xa6ea017771df7617 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.250311:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df75d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e8d expref: 24 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.250321:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5a00/0xa6ea017771df7617 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.250411:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df75d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e8d expref: 24 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.250446:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df75d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e8d expref: 24 pid: 10562 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351259.250462:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626432256:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789351259.250605:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc939b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789351259.255201:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351259.255548:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617000192 00000100:00100000:2.0:1789351259.255560:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617000192 00010000:00010000:2.0:1789351259.255624:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df75d8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e8d expref: 25 pid: 10562 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351259.255677:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:2.0:1789351259.255688:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+25:2348:x1876270617000192:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789351259.255705:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351259.255726:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df75d8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e8d expref: 25 pid: 10562 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.255738:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df75d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e8d expref: 25 pid: 10562 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.255762:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc886e200) 00010000:00010000:2.0:1789351259.255767:0:6676:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5a00/0xa6ea017771df7617 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.255775:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5a00/0xa6ea017771df7617 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.255780:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5a00/0xa6ea017771df7617 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.255797:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789351259.255860:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+25:2348:x1876270617000192:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 174us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351259.255866:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00010000:00010000:1.0:1789351259.256207:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df75d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e8d expref: 24 pid: 10562 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351259.256228:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626432256:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351259.256257:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5a00/0xa6ea017771df7617 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.256267:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5a00/0xa6ea017771df7617 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.256273:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5a00/0xa6ea017771df7617 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351259.256296:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789351259.256564:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df7610 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eb0 expref: 25 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.256583:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5a00/0xa6ea017771df7617 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eb0 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.256591:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc886e200) 00010000:00010000:1.0:1789351259.256594:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789351259.256597:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5a00, rc 0) 00000100:00100000:1.0:1789351259.256644:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd1622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+24:11340:x1876270617000064:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 6682us (6852us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1789351259.256652:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 146 00000100:00100000:3.0:1789351259.258858:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.259155:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617000448 00000100:00100000:1.0:1789351259.259167:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617000448 00000100:00100000:1.0:1789351259.259237:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 147 00000100:00100000:1.0:1789351259.259252:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+24:11340:x1876270617000448:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789351259.259285:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351259.259289:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789351259.259322:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5a00/0xa6ea017771df7617 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eb0 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.259347:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc886e200) 00010000:00010000:1.0:1789351259.259389:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789351259.259410:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7625 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7eb7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.259557:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5600/0xa6ea017771df762c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.259595:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5600/0xa6ea017771df762c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.259607:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5600/0xa6ea017771df762c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351259.259623:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789351259.259768:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7625 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eb7 expref: 26 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.259785:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5600/0xa6ea017771df762c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eb7 expref: 25 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.259793:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c700) 00010000:00010000:1.0:1789351259.259796:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789351259.259799:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5600, rc 0) 00000100:00100000:1.0:1789351259.259881:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+25:11340:x1876270617000448:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 632us (1033us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789351259.259889:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 147 00000100:00100000:3.0:1789351259.262476:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.262598:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617000576 00000100:00100000:1.0:1789351259.262611:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617000576 00000100:00100000:1.0:1789351259.262680:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 148 00000100:00100000:1.0:1789351259.262691:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+25:11340:x1876270617000576:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789351259.262718:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351259.262740:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5200/0xa6ea017771df763a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7ebe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.262834:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5200/0xa6ea017771df763a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ebe expref: 26 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.262852:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5200/0xa6ea017771df763a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ebe expref: 26 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.262891:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c700) 00010000:00010000:1.0:1789351259.262894:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789351259.262898:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5200, rc 0) 00000100:00100000:1.0:1789351259.262961:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+26:11340:x1876270617000576:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 271us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351259.262969:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 148 00000100:00100000:0.0:1789351259.267138:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.270609:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617000704 00000100:00100000:1.0:1789351259.270631:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617000704 00000100:00100000:1.0:1789351259.270718:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:1.0:1789351259.270728:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+6:2347:x1876270617000704:12345-192.168.201.52@tcp:1:lfs.0 00010000:00010000:1.0:1789351259.270826:0:11341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f3e95e/0xa6ea017771df7641 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.270850:0:11341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e9b expref: 6 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.270864:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789351259.270869:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789351259.270873:0:11341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f3e95e/0xa6ea017771df7641 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.270928:0:11341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e9b expref: 6 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.270942:0:11341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e9b expref: 6 pid: 6663 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351259.270956:0:11341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11341:1876270626432384:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789351259.271056:0:11341:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc939b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789351259.275220:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351259.275340:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617000832 00000100:00100000:0.0:1789351259.275353:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617000832 00002000:00100000:0.0:1789351259.275467:0:6668:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d2cc47c3100 x1876270617000832/t0(0) o4->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:515/0 lens 504/0 e 0 to 0 dl 1789351270 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789351259.275481:0:6668:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cc47c3100 with x1876270617000832 ext(0->12) 00010000:00010000:0.0:1789351259.275493:0:6668:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e9b expref: 7 pid: 6663 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.275512:0:6668:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e9b expref: 7 pid: 6663 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789351259.275521:0:6668:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d2cc47c3100 00000100:00100000:0.0:1789351259.275558:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:0.0:1789351259.275572:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270617000832:12345-192.168.201.52@tcp:4:lfs.0 00000100:00100000:0.0:1789351259.276237:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8237986d-b9e8-417a-ac8f-a078390d268c+9:2347:x1876270617000832:12345-192.168.201.52@tcp:4:lfs.0 Request processed in 667us (1032us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789351259.276247:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00002000:00100000:0.0:1789351259.276255:0:6668:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d2cc47c3100 x1876270617000832/t4294967305(0) o4->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:515/0 lens 504/448 e 0 to 0 dl 1789351270 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789351259.276263:0:6668:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cc47c3100 with x1876270617000832 ext(0->12) 00010000:00010000:0.0:1789351259.276268:0:6668:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e9b expref: 9 pid: 6663 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351259.276286:0:6668:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e9b expref: 9 pid: 6663 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789351259.276295:0:6668:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d2cc47c3100 00000100:00100000:1.0:1789351259.276473:0:11341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11341:1876270626432384:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351259.276506:0:11341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000093f3e95e/0xa6ea017771df7641 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351259.279999:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.280136:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617000960 00000100:00100000:1.0:1789351259.280149:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617000960 00010000:00010000:1.0:1789351259.280196:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e9b expref: 9 pid: 6663 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351259.280244:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:1.0:1789351259.280254:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+9:2348:x1876270617000960:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351259.280273:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789351259.280296:0:5809:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789351259.280299:0:5809:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789351259 00002000:00010000:1.0:1789351259.280302:0:5809:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789351259 00002000:00010000:1.0:1789351259.280304:0:5809:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789351259 00010000:00010000:1.0:1789351259.280328:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e9b expref: 9 pid: 6663 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.280352:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e9b expref: 9 pid: 6663 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.280694:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df75ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e9b expref: 9 pid: 6663 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.280717:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789351259.280779:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789351259.280786:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000093f3e95e/0xa6ea017771df7641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.280798:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f3e95e/0xa6ea017771df7641 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.280838:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351259.280910:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+8:2348:x1876270617000960:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 656us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351259.280919:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 65 00010000:00010000:3.0:1789351259.280988:0:11341:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000093f3e95e/0xa6ea017771df7641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.280998:0:11341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093f3e95e/0xa6ea017771df7641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.281027:0:11341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f3e95e/0xa6ea017771df7641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.281037:0:11341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093f3e95e/0xa6ea017771df7641 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.281058:0:11341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093f3e95e/0xa6ea017771df7641 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.281066:0:11341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4800 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351259.281070:0:11341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f3e95e/0xa6ea017771df7641 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.281081:0:11341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f3e95e/0xa6ea017771df7641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.281094:0:11341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093f3e95e/0xa6ea017771df7641 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.281102:0:11341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093f3e95e/0xa6ea017771df7641 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351259.281168:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270617000704:12345-192.168.201.52@tcp:1:lfs.0 Request processed in 10441us (14044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351259.281176:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:3.0:1789351259.283628:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351259.283747:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617001216 00000100:00100000:2.0:1789351259.283759:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617001216 00000100:00100000:2.0:1789351259.283825:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:2.0:1789351259.283846:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf035c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+26:11340:x1876270617001216:12345-192.168.201.52@tcp:35:lfs.0 00000004:00010000:2.0:1789351259.283922:0:5826:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5600/0xa6ea017771df762c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eb7 expref: 26 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789351259.284277:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1789351259.284323:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1789351259.285777:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1789351259.285845:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7648 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.285871:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5200/0xa6ea017771df763a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ebe expref: 30 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.285880:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7648 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.285928:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5200/0xa6ea017771df763a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ebe expref: 30 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.285946:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5200/0xa6ea017771df763a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ebe expref: 30 pid: 5822 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351259.285965:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee7e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1876270626432512:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351259.286081:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2c64840 going to sleep for 11 seconds 00000100:00100000:0.0:1789351259.288560:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.288873:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617001344 00000100:00100000:1.0:1789351259.288886:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617001344 00010000:00010000:1.0:1789351259.288936:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5200/0xa6ea017771df763a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ebe expref: 31 pid: 5822 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351259.288983:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:1.0:1789351259.288998:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+31:2347:x1876270617001344:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351259.289048:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351259.289057:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5200/0xa6ea017771df763a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ebe expref: 31 pid: 5822 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.289074:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5200/0xa6ea017771df763a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ebe expref: 31 pid: 5822 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.289101:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c700) 00010000:00010000:1.0:1789351259.289118:0:6676:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7648 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.289131:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7648 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.289139:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7648 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.289162:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351259.289230:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+31:2347:x1876270617001344:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 236us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351259.289238:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 66 00010000:00010000:2.0:1789351259.289454:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5200/0xa6ea017771df763a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ebe expref: 30 pid: 5822 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351259.289476:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee7e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1876270626432512:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351259.289505:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7648 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.289515:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7648 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.289522:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7648 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789351259.289695:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789351259.290288:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1789351259.290597:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee7e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876270626432640:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789351259.290669:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351259.290752:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2c649c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351259.290800:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626432640 00000100:00100000:1.0:1789351259.290808:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626432640 00000100:00100000:1.0:1789351259.291414:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789351259.291426:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5826:x1876270626432640:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789351259.291528:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5826:x1876270626432640:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 104us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351259.291536:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789351259.291718:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee7e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876270626432640:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789351259.292278:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00080000:0.0:1789351259.292333:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789351259.292383:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee7e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876270626432768:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789351259.292542:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351259.292571:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2c64840 going to sleep for 11 seconds 00000100:00100000:0.0:1789351259.292587:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626432768 00000100:00100000:0.0:1789351259.292596:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626432768 00000100:00100000:0.0:1789351259.292639:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789351259.292647:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1876270626432768:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789351259.292852:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5826:x1876270626432768:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 204us (309us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789351259.292860:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789351259.293120:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee7e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876270626432768:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789351259.293189:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1789351259.293232:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7648 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.293258:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7648 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.293267:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7648 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.293274:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351259.293280:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7648 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.293288:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7648 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.293310:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c700) 00010000:00010000:3.0:1789351259.293313:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789351259.293318:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7648 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.293324:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7648 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789351259.293861:0:5826:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789351259.293984:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1789351259.293994:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 203739635265ns, next at 204739633739ns, rc = 0 00000001:00080000:2.0:1789351259.294001:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789351259.294038:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c700) 00010000:00010000:2.0:1789351259.294042:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789351259.294051:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5600/0xa6ea017771df762c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eb7 expref: 34 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351259.294187:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf035c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+33:11340:x1876270617001216:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 10343us (10569us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1789351259.294195:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00000020:00080000:2.0:1789351259.294200:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789351259.295909:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.295982:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617001472 00000100:00100000:1.0:1789351259.295995:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617001472 00000100:00100000:1.0:1789351259.296059:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 149 00000100:00100000:1.0:1789351259.296069:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+33:11340:x1876270617001472:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789351259.296097:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351259.296138:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5a00/0xa6ea017771df764f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7ec5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.296211:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5a00/0xa6ea017771df764f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ec5 expref: 34 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.296227:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5a00/0xa6ea017771df764f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ec5 expref: 34 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.296250:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:1.0:1789351259.296254:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789351259.296258:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5a00, rc 0) 00000100:00100000:1.0:1789351259.296318:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+34:11340:x1876270617001472:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 250us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351259.296335:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 149 00000100:00100000:3.0:1789351259.298742:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.298805:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617001728 00000100:00100000:1.0:1789351259.298817:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617001728 00000100:00100000:1.0:1789351259.298878:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:1.0:1789351259.298891:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+34:11340:x1876270617001728:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789351259.299203:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+35:11340:x1876270617001728:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 315us (481us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1789351259.299212:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:3.0:1789351259.340822:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.340938:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617001984 00000100:00100000:1.0:1789351259.340950:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617001984 00000100:00100000:1.0:1789351259.341019:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 150 00000100:00100000:1.0:1789351259.341031:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+35:11350:x1876270617001984:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789351259.341070:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351259.341094:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df7656 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7ecc expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351259.341251:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1789351259.341437:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df7656 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ecc expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.341454:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc886e100) 00010000:00010000:1.0:1789351259.341467:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789351259.341473:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df7656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ecc expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.341490:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4c00, rc 0) 00000100:00100000:1.0:1789351259.341568:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+36:11350:x1876270617001984:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 539us (760us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1789351259.341575:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 150 00000100:00100000:0.0:1789351259.343660:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351259.343722:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617002112 00000100:00100000:3.0:1789351259.343734:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617002112 00000100:00100000:3.0:1789351259.343840:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 151 00000100:00100000:3.0:1789351259.343851:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+36:11350:x1876270617002112:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:3.0:1789351259.343926:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7664 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.343958:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7664 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.343968:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7664 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.343980:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df766b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.343985:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df766b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.343989:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df766b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344102:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7672 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344128:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7672 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344133:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7672 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789351259.344180:0:9467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7672 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344196:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7664 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344202:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7664 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344215:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7664 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344232:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351259.344237:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7664 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344243:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7664 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344254:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:3.0:1789351259.344257:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351259.344260:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7664 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344265:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7664 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344275:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df766b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344280:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df766b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344283:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df766b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344286:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351259.344287:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df766b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344297:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df766b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344302:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2ce058f300) 00010000:00010000:3.0:1789351259.344304:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351259.344305:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df766b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344308:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df766b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344320:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7672 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344324:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7672 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344328:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7672 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344330:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351259.344332:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7672 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344335:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7672 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344338:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:3.0:1789351259.344339:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351259.344347:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7672 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.344386:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7672 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351259.344461:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+36:11350:x1876270617002112:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 613us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351259.344467:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 151 00000100:00100000:2.0:1789351259.345950:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351259.346039:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617002368 00000100:00100000:0.0:1789351259.346048:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617002368 00000100:00100000:0.0:1789351259.346093:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:0.0:1789351259.346101:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+36:11350:x1876270617002368:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1789351259.346954:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+37:11350:x1876270617002368:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 849us (1007us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789351259.346962:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:1.0:1789351259.369907:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351259.369961:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617002624 00000100:00100000:3.0:1789351259.369973:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617002624 00000100:00100000:3.0:1789351259.370075:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 152 00000100:00100000:3.0:1789351259.370085:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+37:11353:x1876270617002624:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351259.370211:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351259.370242:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7679 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7ed3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370329:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7680 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370349:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7680 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370389:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7680 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370401:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7687 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370406:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370431:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370595:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df768e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370601:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df768e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370606:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df768e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351259.370616:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789351259.370739:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7680 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370747:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7680 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370754:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7680 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370762:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351259.370768:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7680 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370774:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7680 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370785:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:3.0:1789351259.370788:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351259.370797:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7680 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370802:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7680 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370814:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370818:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7687 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370822:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7687 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370825:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351259.370826:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7687 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370830:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7687 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370833:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2ce058f300) 00010000:00010000:3.0:1789351259.370835:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351259.370836:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7687 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370839:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df7687 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370876:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7679 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ed3 expref: 40 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370895:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df768e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ed3 expref: 39 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.370900:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:3.0:1789351259.370902:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789351259.370904:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105200, rc 0) 00000100:00100000:3.0:1789351259.370972:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+39:11353:x1876270617002624:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 888us (1079us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1789351259.370978:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 152 00000100:00100000:3.0:1789351259.374804:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.375012:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617002752 00000100:00100000:1.0:1789351259.375023:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617002752 00000100:00100000:1.0:1789351259.375085:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 153 00000100:00100000:1.0:1789351259.375093:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+39:11353:x1876270617002752:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:1.0:1789351259.375300:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df769c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.375333:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df769c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.375344:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df769c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.375498:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df769c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.375506:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df769c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.375555:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df769c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.375560:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351259.375565:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df769c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.375571:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df769c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.375583:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:1.0:1789351259.375585:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789351259.375589:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df769c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.375594:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df769c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351259.375749:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+39:11353:x1876270617002752:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 655us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351259.375767:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 153 00000100:00100000:3.0:1789351259.377965:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.378148:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617003008 00000100:00100000:1.0:1789351259.378160:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617003008 00000100:00100000:1.0:1789351259.378221:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:1.0:1789351259.378233:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+39:11353:x1876270617003008:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789351259.378543:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+40:11353:x1876270617003008:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 312us (589us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789351259.378552:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:2.0:1789351259.542416:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351259.542724:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617003264 00000100:00100000:3.0:1789351259.542737:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617003264 00000100:00100000:3.0:1789351259.542885:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 154 00000100:00100000:3.0:1789351259.542898:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+40:11384:x1876270617003264:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:3.0:1789351259.542931:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351259.542959:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7eda expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.543098:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.543129:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.543145:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351259.543187:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789351259.543395:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eda expref: 43 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.543419:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eda expref: 42 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.543430:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:3.0:1789351259.543433:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789351259.543437:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104200, rc 0) 00000100:00100000:3.0:1789351259.543526:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+42:11384:x1876270617003264:12345-192.168.201.52@tcp:101:cat.0 Request processed in 630us (1170us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789351259.543534:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 154 00000100:00100000:0.0:1789351259.547018:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351259.547130:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351259.547205:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617003648 00000100:00100000:3.0:1789351259.547226:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617003648 00000100:00100000:3.0:1789351259.547302:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:3.0:1789351259.547314:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+42:11384:x1876270617003648:12345-192.168.201.52@tcp:35:cat.0 00000100:00100000:3.0:1789351259.547679:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+43:11384:x1876270617003648:12345-192.168.201.52@tcp:35:cat.0 Request processed in 367us (548us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789351259.547749:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:1.0:1789351259.548131:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617003392 00000100:00100000:1.0:1789351259.548138:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617003392 00000100:00100000:1.0:1789351259.548192:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:1.0:1789351259.548202:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+43:2350:x1876270617003392:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351259.548216:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351259.548247:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eda expref: 43 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.548880:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:1.0:1789351259.548888:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351259.549113:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+42:2350:x1876270617003392:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 900us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351259.549122:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:0.0:1789351259.584825:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351259.584934:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617003904 00000100:00100000:3.0:1789351259.584946:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617003904 00000100:00100000:3.0:1789351259.585040:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 155 00000100:00100000:3.0:1789351259.585053:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+42:11390:x1876270617003904:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:3.0:1789351259.585083:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351259.585092:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789351259.585143:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7609 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ea9 expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.585169:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:3.0:1789351259.585173:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351259.585188:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7ee1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.585544:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df76bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.585558:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df768e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ed3 expref: 42 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.585565:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df76bf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.585602:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df768e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ed3 expref: 42 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.585614:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df768e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ed3 expref: 42 pid: 5824 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351259.585627:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626432896:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351259.585752:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cffa71540 going to sleep for 11 seconds 00000100:00100000:0.0:1789351259.587612:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.587697:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617004032 00000100:00100000:1.0:1789351259.587710:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617004032 00010000:00010000:1.0:1789351259.587769:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df768e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ed3 expref: 43 pid: 5824 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351259.587838:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:1.0:1789351259.587848:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6580c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+43:2347:x1876270617004032:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351259.587867:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351259.587874:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df768e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ed3 expref: 43 pid: 5824 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.587887:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df768e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ed3 expref: 43 pid: 5824 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.587918:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:1.0:1789351259.587923:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df76bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.587935:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df76bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.587942:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df76bf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.587962:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351259.588018:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6580c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+43:2347:x1876270617004032:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 171us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351259.588025:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 67 00010000:00010000:3.0:1789351259.588159:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df768e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ed3 expref: 42 pid: 5824 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351259.588193:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626432896:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351259.588478:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df76bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.588490:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df76bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.588497:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df76bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351259.588517:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789351259.588687:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ee1 expref: 43 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.588705:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df76bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ee1 expref: 42 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.588713:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:3.0:1789351259.588716:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789351259.588719:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104e00, rc 0) 00000100:00100000:3.0:1789351259.588755:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+42:11390:x1876270617003904:12345-192.168.201.52@tcp:101:dd.0 Request processed in 3705us (3941us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789351259.588763:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 155 00000100:00100000:0.0:1789351259.590498:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.590598:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617004288 00000100:00100000:1.0:1789351259.590611:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617004288 00000100:00100000:1.0:1789351259.590685:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 156 00000100:00100000:1.0:1789351259.590697:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+42:11390:x1876270617004288:12345-192.168.201.52@tcp:36:dd.0 00010000:00010000:1.0:1789351259.591025:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df76cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.591044:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df76cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.591059:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df76cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789351259.591136:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1789351259.591156:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d96600e4 reply state 000000002a2f9bc6 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df76cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351259.591163:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789351259.591305:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+45:11390:x1876270617004288:12345-192.168.201.52@tcp:36:dd.0 Request processed in 611us (816us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1789351259.591311:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 156 00000020:00080000:1.0:1789351259.591315:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789351259.592826:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df76cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.592844:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df76cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.592853:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df76cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.592861:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351259.592866:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df76cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.592875:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df76cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.592916:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:1.0:1789351259.592920:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351259.592926:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df76cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.592933:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df76cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351259.733620:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351259.734169:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617004416 00000100:00100000:3.0:1789351259.734182:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617004416 00000100:00100000:3.0:1789351259.734318:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 157 00000100:00100000:3.0:1789351259.734333:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+44:11404:x1876270617004416:12345-192.168.201.52@tcp:101:stat.0 00010000:00010000:3.0:1789351259.734613:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351259.734642:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7ee8 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.734733:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df76db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.734752:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df76db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.734765:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df76db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.734783:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df76e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.734791:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df76e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.734798:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df76e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.734928:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.734941:0:9467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df76bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ee1 expref: 45 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.734950:0:9467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76e9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.734994:0:9467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df76bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ee1 expref: 45 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.735019:0:9467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df76bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ee1 expref: 45 pid: 5824 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351259.735037:0:9467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9467:1876270626433024:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351259.735671:0:9467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cffa71000 going to sleep for 11 seconds 00000100:00100000:0.0:1789351259.738797:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351259.739300:0:9467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9467:1876270626433024:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351259.739455:0:9467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351259.739533:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617004672 00000100:00100000:1.0:1789351259.739550:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617004672 00000100:00100000:1.0:1789351259.739623:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:1.0:1789351259.739638:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+46:5581:x1876270617004672:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789351259.739979:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+47:5581:x1876270617004672:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 345us (1196us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1789351259.739990:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:0.0:1789351259.741959:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.742079:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617004800 00000100:00100000:1.0:1789351259.742091:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617004800 00010000:00010000:1.0:1789351259.742151:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df76bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ee1 expref: 47 pid: 5824 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351259.742196:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:1.0:1789351259.742207:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+47:2348:x1876270617004800:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351259.742224:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351259.742232:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df76bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ee1 expref: 47 pid: 5824 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.742248:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df76bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ee1 expref: 47 pid: 5824 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.742307:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104e00/0xa6ea017771df76bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ee1 expref: 47 pid: 5824 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.742329:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:1.0:1789351259.742335:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.742886:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.742896:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76e9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.742935:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351259.743001:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+46:2348:x1876270617004800:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 794us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351259.743010:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 68 00010000:00010000:3.0:1789351259.743599:0:9467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743611:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351259.743730:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789351259.743735:0:9467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351259.743760:0:9467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743773:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743782:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df76db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743787:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df76db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743806:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df76db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743812:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351259.743815:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df76db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743820:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df76db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743831:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:3.0:1789351259.743834:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351259.743837:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df76db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743842:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df76db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743853:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df76e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743856:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df76e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743860:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df76e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743863:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351259.743865:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df76e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743876:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df76e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743881:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2ce058f300) 00010000:00010000:3.0:1789351259.743883:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351259.743884:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df76e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743887:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df76e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743925:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ee8 expref: 46 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743935:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ee8 expref: 45 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.743939:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:3.0:1789351259.743940:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789351259.743941:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104200, rc 0) 00000100:00100000:3.0:1789351259.744036:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+45:11404:x1876270617004416:12345-192.168.201.52@tcp:101:stat.0 Request processed in 9706us (10431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351259.744046:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 157 00000100:00100000:0.0:1789351259.800267:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351259.800664:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617005056 00000100:00100000:3.0:1789351259.800678:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617005056 00000100:00100000:3.0:1789351259.800817:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 158 00000100:00100000:3.0:1789351259.800831:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+45:11410:x1876270617005056:12345-192.168.201.52@tcp:36:truncate.0 00010000:00010000:3.0:1789351259.800939:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351259.800974:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df76e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ee8 expref: 45 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.800998:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:3.0:1789351259.801002:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351259.801289:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.801302:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.801311:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789351259.801434:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1789351259.801463:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b35658d9 reply state 00000000dd8a6617 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351259.801473:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789351259.801602:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+47:11410:x1876270617005056:12345-192.168.201.52@tcp:36:truncate.0 Request processed in 774us (1351us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789351259.801612:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 158 00000020:00080000:3.0:1789351259.801619:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789351259.803745:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.803765:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.803774:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.803780:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351259.803786:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.803817:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.803839:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:1.0:1789351259.803843:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351259.803849:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351259.803855:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104400/0xa6ea017771df76f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351259.809793:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cd827c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626433152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789351259.809884:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351259.810035:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626433152 00000100:00100000:0.0:1789351259.810047:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626433152 00000100:00100000:0.0:1789351259.810123:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789351259.810136:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1876270626433152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789351259.810167:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789351259.810240:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1876270626433152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351259.810245:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789351259.810556:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cd827c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626433152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789351259.929069:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351259.929158:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617005184 00000100:00100000:2.0:1789351259.929191:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617005184 00000100:00100000:2.0:1789351259.929285:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 159 00000100:00100000:2.0:1789351259.929298:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+46:11424:x1876270617005184:12345-192.168.201.52@tcp:101:stat.0 00010000:00010000:2.0:1789351259.929522:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351259.929552:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df76f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7eef expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.929647:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df76fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.929664:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df76fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.929678:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df76fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.929889:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7705 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.929899:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.929908:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930042:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df770c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930052:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df770c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930060:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df770c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351259.930127:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789351259.930133:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351259.930164:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df770c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930179:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df770c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930190:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df76fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930197:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df76fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930205:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df76fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930213:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351259.930232:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df76fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930242:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df76fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930256:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:2.0:1789351259.930260:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351259.930266:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df76fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930272:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df76fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930303:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930310:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7705 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930317:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7705 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930592:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351259.930596:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7705 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930603:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7705 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930613:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2ce9e1a800) 00010000:00010000:2.0:1789351259.930616:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351259.930620:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7705 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930626:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7705 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930673:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df76f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eef expref: 48 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930699:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df770c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eef expref: 47 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351259.930719:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:2.0:1789351259.930722:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789351259.930725:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1a00, rc 0) 00000100:00100000:2.0:1789351259.930816:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+47:11424:x1876270617005184:12345-192.168.201.52@tcp:101:stat.0 Request processed in 1519us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351259.930825:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 159 00000100:00100000:0.0:1789351259.980736:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351259.980922:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617005440 00000100:00100000:3.0:1789351259.980936:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617005440 00000100:00100000:3.0:1789351259.981031:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 160 00000100:00100000:3.0:1789351259.981045:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+47:11434:x1876270617005440:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351259.981293:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351259.981323:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7ef6 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351259.981584:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1789351259.981817:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7713 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ef6 expref: 49 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.981835:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc886e100) 00010000:00010000:3.0:1789351259.981839:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789351259.981844:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ef6 expref: 49 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351259.981862:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104200, rc 0) 00000100:00100000:3.0:1789351259.981990:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+48:11434:x1876270617005440:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 947us (1269us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1789351259.982008:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 160 00000100:00100000:0.0:1789351259.984574:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351259.984842:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617005696 00000100:00100000:1.0:1789351259.984855:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617005696 00000100:00100000:1.0:1789351259.984952:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:1.0:1789351259.984965:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf035e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+48:11434:x1876270617005696:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789351259.985308:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf035e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+49:11434:x1876270617005696:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 345us (744us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1789351259.985317:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:0.0:1789351260.025285:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.025354:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617005952 00000100:00100000:3.0:1789351260.025389:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617005952 00000100:00100000:3.0:1789351260.025531:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 161 00000100:00100000:3.0:1789351260.025544:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+49:11440:x1876270617005952:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789351260.025580:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351260.025606:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7721 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7efd expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.025779:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7728 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.025806:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df770c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eef expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.025816:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7728 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.025857:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df770c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eef expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.025874:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df770c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eef expref: 50 pid: 5823 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351260.025889:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d67100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626433280:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351260.026020:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cffa71540 going to sleep for 11 seconds 00000100:00100000:3.0:1789351260.028981:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d67100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626433280:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351260.029019:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7728 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351260.029041:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351260.030203:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617006080 00000100:00100000:1.0:1789351260.030217:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617006080 00010000:00010000:1.0:1789351260.030273:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df770c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eef expref: 51 pid: 5823 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351260.030327:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:1.0:1789351260.030338:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+51:2349:x1876270617006080:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351260.030846:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351260.030874:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df770c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eef expref: 51 pid: 5823 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.030890:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df770c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eef expref: 51 pid: 5823 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.030920:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df770c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7eef expref: 51 pid: 5823 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.030939:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:1.0:1789351260.030946:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7728 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.030958:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7728 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.030966:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7728 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.031004:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351260.031069:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7728 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.031079:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7728 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351260.031091:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+50:2349:x1876270617006080:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 754us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351260.031109:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 69 00000004:00200000:3.0:1789351260.031164:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789351260.031518:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7721 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7efd expref: 51 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.031552:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7728 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7efd expref: 50 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.031560:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:3.0:1789351260.031563:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789351260.031566:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104600, rc 0) 00000100:00100000:3.0:1789351260.031597:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+50:11440:x1876270617005952:12345-192.168.201.52@tcp:101:bash.0 Request processed in 6056us (6330us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789351260.031605:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 161 00000100:00100000:0.0:1789351260.036566:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351260.036694:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617006336 00000100:00100000:2.0:1789351260.036708:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617006336 00000100:00100000:2.0:1789351260.036774:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 162 00000100:00100000:2.0:1789351260.036783:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+50:11440:x1876270617006336:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:2.0:1789351260.037090:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7736 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.037122:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7736 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.037137:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7736 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789351260.037187:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1789351260.037206:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000876bcf74 reply state 000000001ca8535f transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7736 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351260.037224:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789351260.037438:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+53:11440:x1876270617006336:12345-192.168.201.52@tcp:36:bash.0 Request processed in 655us (887us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789351260.037444:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 162 00000020:00080000:2.0:1789351260.037466:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789351260.039157:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7736 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.039175:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7736 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.039184:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7736 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.039211:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351260.039217:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7736 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.039225:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7736 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.039244:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:1.0:1789351260.039247:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351260.039252:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7736 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.039257:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7736 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351260.042420:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.042482:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617006464 00000100:00100000:3.0:1789351260.042497:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617006464 00000100:00100000:3.0:1789351260.042577:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 163 00000100:00100000:3.0:1789351260.042590:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+52:11440:x1876270617006464:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789351260.042626:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351260.042661:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df773d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f04 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.042774:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7744 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.042792:0:9467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7728 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7efd expref: 53 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.042801:0:9467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7744 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.042848:0:9467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7728 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7efd expref: 53 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.042882:0:9467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7728 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7efd expref: 53 pid: 5824 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351260.042901:0:9467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d67100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9467:1876270626433408:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351260.043011:0:9467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cffa71000 going to sleep for 11 seconds 00000100:00100000:2.0:1789351260.045706:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351260.045768:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617006592 00000100:00100000:0.0:1789351260.045780:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617006592 00010000:00010000:0.0:1789351260.045828:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7728 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7efd expref: 54 pid: 5824 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351260.045839:0:9467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d67100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9467:1876270626433408:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351260.045867:0:9467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7744 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351260.045921:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:0.0:1789351260.045931:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+54:2347:x1876270617006592:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351260.045955:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351260.045962:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7728 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7efd expref: 54 pid: 5824 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.045972:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7728 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7efd expref: 54 pid: 5824 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.045994:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7728 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7efd expref: 54 pid: 5824 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.046009:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:0.0:1789351260.046013:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7744 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.046021:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.046027:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7744 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.046047:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351260.046070:0:9467:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.046077:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351260.046123:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+53:2347:x1876270617006592:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 192us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351260.046132:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 70 00000004:00200000:3.0:1789351260.046496:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789351260.046503:0:9467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351260.046530:0:9467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.046574:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df773d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f04 expref: 53 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.046592:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7744 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f04 expref: 52 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.046600:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:3.0:1789351260.046611:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789351260.046615:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105200, rc 0) 00000100:00100000:3.0:1789351260.046711:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+52:11440:x1876270617006464:12345-192.168.201.52@tcp:101:bash.0 Request processed in 4124us (4302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351260.046718:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 163 00000100:00100000:2.0:1789351260.052312:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.053763:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617006848 00000100:00100000:3.0:1789351260.053779:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617006848 00000100:00100000:3.0:1789351260.053856:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:3.0:1789351260.053870:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+52:11440:x1876270617006848:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:3.0:1789351260.054175:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+53:11440:x1876270617006848:12345-192.168.201.52@tcp:35:bash.0 Request processed in 307us (1878us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1789351260.054181:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:0.0:1789351260.120588:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.120708:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617007104 00000100:00100000:3.0:1789351260.120723:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617007104 00000100:00100000:3.0:1789351260.120806:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 164 00000100:00100000:3.0:1789351260.120819:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+53:11450:x1876270617007104:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351260.120853:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351260.120881:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df774b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f0b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351260.121050:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1789351260.121478:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df774b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f0b expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.121496:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc886e100) 00010000:00010000:3.0:1789351260.121499:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789351260.121506:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df774b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f0b expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.121545:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104200, rc 0) 00000100:00100000:3.0:1789351260.121635:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+54:11450:x1876270617007104:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 817us (1060us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1789351260.121643:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 164 00000100:00100000:2.0:1789351260.130753:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351260.130915:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617007232 00000100:00100000:1.0:1789351260.130932:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617007232 00000100:00100000:1.0:1789351260.131007:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 165 00000100:00100000:1.0:1789351260.131019:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+54:11450:x1876270617007232:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:1.0:1789351260.131119:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df7759 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131140:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df7759 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131154:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df7759 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131173:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7760 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131202:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131208:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131328:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7767 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131345:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131352:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789351260.131425:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131437:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df7759 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131442:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df7759 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131447:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df7759 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131451:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351260.131455:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df7759 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131460:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df7759 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131477:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:1.0:1789351260.131479:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351260.131483:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df7759 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131488:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df7759 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131499:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131502:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7760 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131505:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131509:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351260.131510:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131514:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7760 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131517:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2cc3d1c100) 00010000:00010000:1.0:1789351260.131519:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351260.131520:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7760 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131523:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df7760 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131539:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131543:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7767 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131547:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7767 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131550:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351260.131551:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7767 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131554:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7767 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131558:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:1.0:1789351260.131559:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351260.131561:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7767 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.131564:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7767 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351260.131815:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+54:11450:x1876270617007232:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 796us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351260.131822:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 165 00010000:00010000:3.0:1789351260.132598:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789351260.135595:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351260.135673:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617007488 00000100:00100000:1.0:1789351260.135686:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617007488 00000100:00100000:1.0:1789351260.135759:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:1.0:1789351260.135787:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+54:11450:x1876270617007488:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1789351260.136106:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+55:11450:x1876270617007488:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 320us (522us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1789351260.136115:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:0.0:1789351260.166445:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.166635:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617007744 00000100:00100000:3.0:1789351260.166658:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617007744 00000100:00100000:3.0:1789351260.166742:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 166 00000100:00100000:3.0:1789351260.166755:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+55:11453:x1876270617007744:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351260.166787:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351260.166812:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df776e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f12 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.167138:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7775 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.167158:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7775 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.167171:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7775 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.167189:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df777c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.167198:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df777c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.167229:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df777c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.170229:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df7783 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.170259:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df7783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.170274:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df7783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351260.170292:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789351260.171046:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7775 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.171059:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7775 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.171066:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7775 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.171073:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351260.171078:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7775 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.171086:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7775 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.171115:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:2.0:1789351260.171136:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351260.171142:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7775 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.171150:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7775 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.171171:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df777c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.171178:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df777c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.171185:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df777c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.171191:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351260.171193:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df777c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.171200:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df777c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.171208:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2ce058f300) 00010000:00010000:2.0:1789351260.171210:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351260.171213:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df777c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.171220:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df777c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.171286:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df776e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f12 expref: 58 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.171315:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df7783 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f12 expref: 57 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.171324:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:2.0:1789351260.171326:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789351260.172082:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0200, rc 0) 00000100:00100000:2.0:1789351260.172198:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+57:11453:x1876270617007744:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 5443us (5765us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789351260.172209:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 166 00000100:00100000:2.0:1789351260.174720:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351260.174872:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617007872 00000100:00100000:1.0:1789351260.174885:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617007872 00000100:00100000:1.0:1789351260.175102:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 167 00000100:00100000:1.0:1789351260.175116:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+57:11453:x1876270617007872:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:1.0:1789351260.175211:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7791 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.175234:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.175248:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.175286:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.175294:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7791 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.175302:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7791 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.175308:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351260.175314:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7791 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.175350:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7791 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.175392:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:1.0:1789351260.175395:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789351260.175400:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7791 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.175407:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7791 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351260.175514:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+57:11453:x1876270617007872:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 400us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351260.175523:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 167 00000100:00100000:0.0:1789351260.176491:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351260.176637:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617008000 00000100:00100000:1.0:1789351260.176646:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617008000 00000100:00100000:1.0:1789351260.176706:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1789351260.176716:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+57:2347:x1876270617008000:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351260.176732:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351260.176752:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df7783 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f12 expref: 57 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.176769:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:1.0:1789351260.176773:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351260.176818:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+56:2347:x1876270617008000:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 104us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351260.176826:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:3.0:1789351260.177396:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351260.177490:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617008256 00000100:00100000:2.0:1789351260.177497:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617008256 00000100:00100000:2.0:1789351260.177538:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:2.0:1789351260.177545:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+57:11453:x1876270617008256:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1789351260.177780:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+58:11453:x1876270617008256:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 234us (385us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789351260.177787:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:2.0:1789351260.308736:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351260.308864:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617008512 00000100:00100000:1.0:1789351260.308879:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617008512 00000100:00100000:1.0:1789351260.308967:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 168 00000100:00100000:1.0:1789351260.308978:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+57:11471:x1876270617008512:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:1.0:1789351260.309012:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351260.309039:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7798 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f19 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.309202:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df779f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.309220:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df779f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.309234:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df779f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351260.309250:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789351260.309485:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7798 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f19 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.309524:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df779f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f19 expref: 59 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.309535:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:1.0:1789351260.309538:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789351260.309543:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5e00, rc 0) 00000100:00100000:1.0:1789351260.309635:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+59:11471:x1876270617008512:12345-192.168.201.52@tcp:101:cat.0 Request processed in 659us (912us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789351260.309668:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 168 00000100:00100000:2.0:1789351260.331185:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351260.331253:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617008640 00000100:00100000:1.0:1789351260.331267:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617008640 00000100:00100000:1.0:1789351260.331337:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 169 00000100:00100000:1.0:1789351260.331350:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+59:11472:x1876270617008640:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789351260.331418:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351260.331444:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df77ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f20 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.331530:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df77b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.331547:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df77b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.331561:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df77b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351260.331788:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1789351260.331793:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789351260.331873:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df77b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.331906:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df77ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f20 expref: 61 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.331927:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df77b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f20 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.331951:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:1.0:1789351260.331955:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789351260.331960:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4c00, rc 0) 00000100:00100000:1.0:1789351260.333121:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+60:11472:x1876270617008640:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1764us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351260.333137:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 169 00000100:00100000:2.0:1789351260.342498:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.342594:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617009024 00000100:00100000:3.0:1789351260.342607:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617009024 00000100:00100000:3.0:1789351260.342681:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:3.0:1789351260.342695:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+60:11472:x1876270617009024:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1789351260.343204:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+61:11472:x1876270617009024:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 510us (714us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789351260.343214:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:0.0:1789351260.345200:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351260.345353:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617009152 00000100:00100000:1.0:1789351260.345390:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617009152 00000100:00100000:1.0:1789351260.345466:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:1.0:1789351260.345480:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+61:11472:x1876270617009152:12345-192.168.201.52@tcp:103:lfs.0 00010000:00010000:1.0:1789351260.345500:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789351260.345536:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7744 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f04 expref: 61 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.345565:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df779f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f19 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.345581:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5a00/0xa6ea017771df764f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ec5 expref: 59 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.345594:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c200) 00010000:00010000:1.0:1789351260.345609:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351260.345675:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+58:11472:x1876270617009152:12345-192.168.201.52@tcp:103:lfs.0 Request processed in 199us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351260.345685:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:1.0:1789351260.347241:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351260.348195:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617009280 00000100:00100000:0.0:1789351260.348218:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617009280 00000100:00100000:1.0:1789351260.348338:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 170 00000100:00100000:1.0:1789351260.348351:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+58:11472:x1876270617009280:12345-192.168.201.52@tcp:58:lfs.0 00010000:00010000:1.0:1789351260.348506:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df77bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.348528:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df77bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.348540:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df77bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789351260.348877:0:10562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1789351260.348984:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+58:11472:x1876270617009280:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 634us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351260.348990:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 170 00000001:00080000:1.0:1789351260.360194:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967434 is committed 00000020:00080000:1.0:1789351260.360231:0:5844:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1789351260.360250:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000020:00080000:0.0:1789351260.360258:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789351260.360272:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000004:00080000:1.0:1789351260.361874:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789351260.361910:0:5844:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2cc2c649c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1789351260.361915:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d2cc5e29700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2cc2c64300 00000020:00080000:1.0:1789351260.361919:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d2cc5e29c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2cd142d000 00000020:00080000:0.0:1789351260.362122:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:3.0:1789351260.362345:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626433536:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1789351260.362414:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1789351260.362471:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351260.362526:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626433536 00000100:00100000:1.0:1789351260.362538:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626433536 00000100:00100000:1.0:1789351260.362601:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789351260.362612:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626433536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789351260.362643:0:11977:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1789351260.362703:0:11977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa7555b, atime: 0x6aa7555b, ctime: 0x6aa7555b, blocks: 0x1 00010000:00010000:1.0:1789351260.362713:0:11977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086613d17/0xa6ea017771df77c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.362735:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=204s v=(0 0) 00010000:00010000:1.0:1789351260.362740:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789351260.362749:0:11977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086613d17/0xa6ea017771df77c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.362768:0:11977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086613d17/0xa6ea017771df77c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.362785:0:11977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086613d17/0xa6ea017771df77c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.362806:0:11977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086613d17/0xa6ea017771df77c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.362828:0:11977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789351260.362943:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351260.362951:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086613d17/0xa6ea017771df77c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.362960:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5a00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351260.362964:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086613d17/0xa6ea017771df77c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.362974:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086613d17/0xa6ea017771df77c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.362993:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086613d17/0xa6ea017771df77c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.363009:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086613d17/0xa6ea017771df77c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351260.363020:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:3.0:1789351260.363035:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351260.363038:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351260.363041:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351260.363121:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617009408 00000100:00100000:0.0:1789351260.363128:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617009408 00000100:00100000:0.0:1789351260.363207:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 171 00000100:00100000:0.0:1789351260.363217:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+17:11474:x1876270617009408:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789351260.363233:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351260.363251:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df77c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f27 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363325:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df77d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363339:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df77d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363350:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df77d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363382:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df77d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363390:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df77d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363400:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df77d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351260.363570:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3288:x1876270626433536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 957us (1096us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789351260.363580:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1789351260.363616:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2cf9d8fb80/2, rc 0, transno 4294967307 00000100:00100000:3.0:1789351260.363626:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626433536:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789351260.363735:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df77de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363751:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df77de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363758:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df77de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351260.363807:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789351260.363813:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789351260.363836:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df77de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363848:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df77de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363857:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df77d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363863:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df77d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363869:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df77d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363876:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351260.363880:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df77d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363887:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df77d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363898:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:0.0:1789351260.363901:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351260.363912:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df77d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363918:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df77d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363930:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df77d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363936:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df77d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363942:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df77d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363948:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351260.363950:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df77d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363956:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df77d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363964:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2cc886ed00) 00010000:00010000:0.0:1789351260.363966:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351260.363969:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df77d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.363975:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df77d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.364008:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df77c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f27 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.364032:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df77de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f27 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.364040:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:0.0:1789351260.364042:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789351260.364045:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9000, rc 0) 00000100:00100000:0.0:1789351260.364107:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+18:11474:x1876270617009408:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 892us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351260.364114:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 171 00000040:00080000:0.0:1789351260.451924:0:11642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789351260.451938:0:11642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789351260.451985:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789351260.451992:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789351260.452782:0:11642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa10e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11642:1876270626433664:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789351260.452952:0:11642:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc939bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789351260.454597:0:11642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa10e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11642:1876270626433664:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789351260.455498:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.455650:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617009536 00000100:00100000:3.0:1789351260.455663:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617009536 00000100:00100000:3.0:1789351260.455742:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 172 00000100:00100000:3.0:1789351260.455756:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+18:11485:x1876270617009536:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789351260.455803:0:5822:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789351260.455941:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+18:11485:x1876270617009536:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 187us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351260.455950:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 172 00000100:00100000:3.0:1789351260.463953:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351260.464007:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617009664 00000100:00100000:1.0:1789351260.464028:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617009664 00000100:00100000:1.0:1789351260.464108:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 173 00000100:00100000:1.0:1789351260.464121:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+18:11485:x1876270617009664:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789351260.464228:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df77e5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464249:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df77e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464264:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df77e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464282:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df77ec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464291:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df77ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464298:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df77ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464335:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df77f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464345:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df77f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464351:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df77f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351260.464421:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789351260.464435:0:10562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789351260.464451:0:10562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df77f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464467:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df77e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464474:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df77e5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464481:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df77e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464486:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351260.464489:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df77e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464496:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df77e5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464508:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2cc3d1c800) 00010000:00010000:1.0:1789351260.464510:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351260.464514:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df77e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464519:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df77e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464532:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df77ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464536:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df77ec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464549:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df77ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464553:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351260.464555:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df77ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464559:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df77ec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464564:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8d2cc3d1cf00) 00010000:00010000:1.0:1789351260.464566:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351260.464567:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df77ec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464570:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df77ec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464582:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df77f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464586:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df77f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464590:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df77f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464593:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351260.464594:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df77f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464605:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df77f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464610:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:1.0:1789351260.464612:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351260.464613:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df77f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.464616:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df77f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351260.464789:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+18:11485:x1876270617009664:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 668us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351260.464797:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 173 00000100:00100000:1.0:1789351260.468964:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351260.469475:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617009920 00000100:00100000:0.0:1789351260.469487:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617009920 00000100:00100000:0.0:1789351260.469567:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 174 00000100:00100000:0.0:1789351260.469583:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+18:11485:x1876270617009920:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789351260.469621:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351260.469646:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df77fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f2e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.469793:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df7801 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.469812:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df7801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.469839:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df7801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351260.469855:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789351260.469995:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df7801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.470004:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df7801 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.470019:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df7801 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.470027:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351260.470032:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df7801 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.470040:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df7801 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.470055:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:0.0:1789351260.470058:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789351260.470064:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df7801 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.470069:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df7801 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.470134:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df77fa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f2e expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.470158:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2cc3d1c800) 00010000:00010000:0.0:1789351260.470161:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789351260.470166:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df77fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f2e expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.470177:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9a00, rc 0) 00000100:00100000:0.0:1789351260.470260:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+19:11485:x1876270617009920:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 680us (1306us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1789351260.470268:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 174 00000100:00100000:0.0:1789351260.473749:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351260.473813:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617010048 00000100:00100000:2.0:1789351260.473829:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617010048 00000100:00100000:2.0:1789351260.473909:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 175 00000100:00100000:2.0:1789351260.473925:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+19:11485:x1876270617010048:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789351260.473985:0:5822:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789351260.474189:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+19:11485:x1876270617010048:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 268us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351260.474199:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 175 00000100:00100000:1.0:1789351260.477938:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351260.478002:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617010304 00000100:00100000:2.0:1789351260.478017:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617010304 00000100:00100000:2.0:1789351260.478100:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 176 00000100:00100000:2.0:1789351260.478114:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+19:11485:x1876270617010304:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789351260.478144:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351260.478149:0:10562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789351260.478185:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df77b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f20 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.478210:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:2.0:1789351260.478217:0:10562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351260.478236:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df780f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f35 expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789351260.479246:0:10562:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789351260.480258:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7816 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.480281:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.480294:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.480401:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df780f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f35 expref: 21 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.480420:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7816 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f35 expref: 20 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.480429:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2ce9e1ac00) 00010000:00010000:2.0:1789351260.480432:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789351260.480436:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1000, rc 0) 00000100:00100000:2.0:1789351260.480526:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+20:11485:x1876270617010304:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 2414us (2602us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1789351260.480536:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 176 00000100:00100000:0.0:1789351260.487574:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.487696:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617010560 00000100:00100000:3.0:1789351260.487711:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617010560 00000100:00100000:3.0:1789351260.487878:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 177 00000100:00100000:3.0:1789351260.487891:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+20:11485:x1876270617010560:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789351260.487971:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351260.488006:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7816 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f35 expref: 20 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488041:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2ce9e1ac00) 00010000:00010000:3.0:1789351260.488055:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351260.488097:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7824 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488113:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7824 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488124:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7824 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488141:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df782b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x37d2fec6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488149:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df782b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x37d2fec6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488156:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df782b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x37d2fec6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488755:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7824 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488765:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7824 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488772:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7824 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488779:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351260.488783:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7824 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488798:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7824 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488808:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:3.0:1789351260.488811:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351260.488816:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7824 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488822:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7824 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488834:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df782b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x37d2fec6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488840:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df782b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x37d2fec6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488847:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df782b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x37d2fec6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488852:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351260.488855:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df782b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x37d2fec6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488862:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df782b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x37d2fec6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488869:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x37d2fec6 (ffff8d2ce058fc00) 00010000:00010000:3.0:1789351260.488872:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351260.488874:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df782b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x37d2fec6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.488890:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df782b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x37d2fec6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351260.488995:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+19:11485:x1876270617010560:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 1104us (1435us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789351260.489003:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 177 00000100:00100000:1.0:1789351260.497332:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351260.497426:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617010688 00000100:00100000:2.0:1789351260.497440:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617010688 00000100:00100000:2.0:1789351260.497518:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 178 00000100:00100000:2.0:1789351260.497532:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+19:11485:x1876270617010688:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789351260.497560:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351260.497589:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7832 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f3c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.497635:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7839 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.497652:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.497667:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.497800:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7832 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f3c expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.497818:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7839 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f3c expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.497829:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2ce9e1a800) 00010000:00010000:2.0:1789351260.497833:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789351260.497838:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0800, rc 0) 00000100:00100000:2.0:1789351260.497927:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+20:11485:x1876270617010688:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 398us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351260.497936:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 178 00000100:00100000:1.0:1789351260.500669:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351260.500758:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617010944 00000100:00100000:2.0:1789351260.500771:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617010944 00000100:00100000:2.0:1789351260.500841:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 179 00000100:00100000:2.0:1789351260.500853:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+20:11485:x1876270617010944:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789351260.500969:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7840 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.500990:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.501006:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789351260.501410:0:10562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1789351260.501422:0:10562:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 204947063658ns, next at 205947060739ns, rc = 0 00000004:00010000:2.0:1789351260.501546:0:10562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da061de7 reply state 00000000cb568d8f transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351260.501558:0:10562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789351260.501694:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+22:11485:x1876270617010944:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 841us (1036us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789351260.501703:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 179 00000100:00100000:3.0:1789351260.505583:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.505672:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617011072 00000100:00100000:3.0:1789351260.505684:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617011072 00000100:00100000:3.0:1789351260.505762:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 180 00000100:00100000:3.0:1789351260.505773:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+22:11485:x1876270617011072:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351260.505803:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351260.505824:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7847 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f43 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.505899:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7847 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f43 expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.505916:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7847 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f43 expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.505941:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2ce9e1a800) 00010000:00010000:3.0:1789351260.505945:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789351260.505950:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105800, rc 0) 00000100:00100000:3.0:1789351260.506014:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+23:11485:x1876270617011072:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 241us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351260.506041:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 180 00010000:00010000:1.0:1789351260.506136:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.506147:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7840 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.506155:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7840 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.506163:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351260.506168:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7840 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.506186:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7840 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.506201:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2ce9e1a800) 00010000:00010000:1.0:1789351260.506203:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789351260.506208:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7840 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.506214:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7840 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351260.508303:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351260.509513:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617011200 00000100:00100000:1.0:1789351260.509529:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617011200 00000100:00080000:3.0:1789351260.509582:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789351260.509629:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:1.0:1789351260.509642:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf772fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+6:2347:x1876270617011200:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789351260.510060:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf772fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270617011200:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 420us (1768us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789351260.510069:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:1.0:1789351260.517894:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.517961:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617011456 00000100:00100000:3.0:1789351260.517974:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617011456 00000100:00100000:3.0:1789351260.518353:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:3.0:1789351260.518401:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+22:11485:x1876270617011456:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789351260.518713:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+23:11485:x1876270617011456:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 315us (833us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789351260.518723:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:3.0:1789351260.522500:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351260.522593:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617011712 00000100:00100000:1.0:1789351260.522605:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617011712 00000100:00100000:1.0:1789351260.522685:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 181 00000100:00100000:1.0:1789351260.522698:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+23:11485:x1876270617011712:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789351260.522835:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+23:11485:x1876270617011712:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 139us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351260.522843:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 181 00000100:00100000:1.0:1789351260.527257:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351260.527490:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617011840 00000100:00100000:0.0:1789351260.527502:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617011840 00000100:00100000:0.0:1789351260.527622:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 182 00000100:00100000:0.0:1789351260.527636:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+23:11485:x1876270617011840:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789351260.527666:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351260.527694:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df784e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f4a expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.527790:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7855 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.527809:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.527823:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351260.527880:0:9467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789351260.527903:0:9467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.527936:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df784e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f4a expref: 25 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.527959:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7855 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f4a expref: 24 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.527970:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2ce9e1a800) 00010000:00010000:0.0:1789351260.527973:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789351260.527977:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8800, rc 0) 00000100:00100000:0.0:1789351260.528064:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+24:11485:x1876270617011840:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 432us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351260.528072:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 182 00000100:00100000:0.0:1789351260.531865:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.531951:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617011968 00000100:00100000:3.0:1789351260.531963:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617011968 00000100:00100000:3.0:1789351260.532051:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:3.0:1789351260.532062:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+7:2349:x1876270617011968:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351260.532094:0:11341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351260.532120:0:11341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df785c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f51 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789351260.532152:0:11341:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa7555c, blocks: 0x1 00010000:00010000:3.0:1789351260.532176:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=204s v=(0 0) 00010000:00010000:3.0:1789351260.532181:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351260.532192:0:11341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df785c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f51 expref: 8 pid: 11341 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.532244:0:11341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df785c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f51 expref: 8 pid: 11341 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.532261:0:11341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105e00, rc 0) 00000100:00100000:3.0:1789351260.532335:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+8:2349:x1876270617011968:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 274us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351260.532343:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:2.0:1789351260.535540:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.535623:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617012224 00000100:00100000:3.0:1789351260.535636:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617012224 00000100:00100000:3.0:1789351260.535748:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 183 00000100:00100000:3.0:1789351260.535761:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+24:11485:x1876270617012224:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789351260.535887:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+24:11485:x1876270617012224:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 129us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351260.535896:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 183 00000100:00100000:1.0:1789351260.542166:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.542256:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617012352 00000100:00100000:3.0:1789351260.542270:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617012352 00000100:00100000:3.0:1789351260.542334:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:3.0:1789351260.542345:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8237986d-b9e8-417a-ac8f-a078390d268c+8:11485:x1876270617012352:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351260.542475:0:11977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351260.542498:0:11977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7863 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f58 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.542537:0:11977:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df785c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f51 expref: 9 pid: 11341 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.542568:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351260.542573:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351260.542579:0:11977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7863 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f58 expref: 9 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.542618:0:11977:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df785c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f51 expref: 9 pid: 11341 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.542633:0:11977:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df785c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f51 expref: 9 pid: 11341 timeout: 304 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351260.542650:0:11977:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f65880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11977:1876270626433792:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351260.542854:0:11977:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ceeca1480 going to sleep for 11 seconds 00000100:00100000:0.0:1789351260.546968:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.547076:0:11977:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f65880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11977:1876270626433792:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351260.547133:0:11977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7863 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f58 expref: 9 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.547159:0:11977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104a00, rc 0) 00000100:00100000:3.0:1789351260.547243:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8237986d-b9e8-417a-ac8f-a078390d268c+9:11485:x1876270617012352:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 4899us (5091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351260.547254:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:1.0:1789351260.548174:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617012480 00000100:00100000:1.0:1789351260.548188:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617012480 00010000:00010000:1.0:1789351260.548241:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df785c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f51 expref: 9 pid: 11341 timeout: 304 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351260.548285:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:1.0:1789351260.548298:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+9:2347:x1876270617012480:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351260.548436:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351260.548470:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df785c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f51 expref: 9 pid: 11341 timeout: 304 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.548488:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df785c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f51 expref: 9 pid: 11341 timeout: 304 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.548520:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df785c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f51 expref: 9 pid: 11341 timeout: 304 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.548539:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789351260.548544:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789351260.548553:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7863 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f58 expref: 8 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.548566:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7863 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f58 expref: 8 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.548777:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7863 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f58 expref: 8 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351260.548796:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47c0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5807:1876270626433920:192.168.201.52@tcp:105: 00000100:00100000:1.0:1789351260.548900:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc939bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789351260.550634:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47c0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5807:1876270626433920:192.168.201.52@tcp:105: 00010000:00010000:1.0:1789351260.550674:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351260.550734:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+8:2347:x1876270617012480:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 2437us (3779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351260.550746:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:0.0:1789351260.554478:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351260.554533:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617012608 00000100:00100000:1.0:1789351260.554545:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617012608 00002000:00100000:1.0:1789351260.554621:0:6667:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d2cffa10700 x1876270617012608/t0(0) o4->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:516/0 lens 504/0 e 0 to 0 dl 1789351271 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789351260.554633:0:6667:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cffa10700 with x1876270617012608 ext(0->8) 00002000:00010000:1.0:1789351260.554646:0:6667:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2cffa10700 00000100:00100000:1.0:1789351260.554681:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:1.0:1789351260.554693:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8237986d-b9e8-417a-ac8f-a078390d268c+8:2348:x1876270617012608:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789351260.555298:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8237986d-b9e8-417a-ac8f-a078390d268c+10:2348:x1876270617012608:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 Request processed in 605us (829us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789351260.555309:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00002000:00100000:1.0:1789351260.555318:0:6667:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d2cffa10700 x1876270617012608/t4294967314(0) o4->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:516/0 lens 504/448 e 0 to 0 dl 1789351271 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789351260.555339:0:6667:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cffa10700 with x1876270617012608 ext(0->8) 00002000:00010000:1.0:1789351260.555343:0:6667:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2cffa10700 00000100:00100000:2.0:1789351260.558798:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.558977:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617012736 00000100:00100000:3.0:1789351260.558990:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617012736 00000100:00100000:3.0:1789351260.559128:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 184 00000100:00100000:3.0:1789351260.559156:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+24:11485:x1876270617012736:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789351260.589224:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000020:00080000:3.0:1789351260.589246:0:5844:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1789351260.589264:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1789351260.589271:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:3.0:1789351260.589287:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000100:00100000:3.0:1789351260.589477:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc6f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626434048:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1789351260.589552:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1789351260.589564:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789351260.589571:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351260.589786:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+19:11485:x1876270617012736:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 30629us (30998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351260.589799:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 184 00000100:00100000:2.0:1789351260.590506:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626434048 00000100:00100000:2.0:1789351260.590516:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626434048 00000100:00080000:3.0:1789351260.590575:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789351260.590576:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789351260.590597:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1876270626434048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789351260.590809:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789351260.590814:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789351260 00002000:00010000:2.0:1789351260.590816:0:6661:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789351260.590818:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789351260 -> 1789351260 00002000:00010000:2.0:1789351260.590820:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789351260.590880:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1876270626434048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 294us (1309us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789351260.590888:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1789351260.591264:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2cc6f65880/2, rc 0, transno 4294967315 00000100:00100000:3.0:1789351260.591272:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc6f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626434048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789351260.591275:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351260.591445:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617012864 00000100:00100000:2.0:1789351260.591450:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617012864 00000100:00100000:2.0:1789351260.591516:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:2.0:1789351260.591524:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+10:2347:x1876270617012864:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789351260.626420:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:1.0:1789351260.626451:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1789351260.627045:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270617012864:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 35462us (35713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351260.627060:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:1.0:1789351260.633256:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351260.633402:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617013120 00000100:00100000:2.0:1789351260.633415:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617013120 00000100:00100000:2.0:1789351260.633486:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 185 00000100:00100000:2.0:1789351260.633500:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+19:11485:x1876270617013120:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789351260.633571:0:9467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351260.633604:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7855 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f4a expref: 19 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.633621:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2ce9e1a800) 00010000:00010000:2.0:1789351260.633625:0:9467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351260.633657:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df786a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.633669:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df786a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.633676:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df786a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789351260.634007:0:9467:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cad7c326 reply state 000000000e607774 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df786a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351260.634017:0:9467:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789351260.634164:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+20:11485:x1876270617013120:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 663us (917us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789351260.634186:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 185 00000100:00100000:1.0:1789351260.640633:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.640721:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617013248 00000100:00100000:3.0:1789351260.640738:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617013248 00000100:00100000:3.0:1789351260.640878:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:3.0:1789351260.640892:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270617013248:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789351260.641239:0:11977:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789351260.641244:0:11977:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789351260 -> 1789351260 00002000:00010000:3.0:1789351260.641248:0:11977:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789351259 00002000:00010000:3.0:1789351260.641251:0:11977:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789351260 -> 1789351260 00002000:00010000:3.0:1789351260.641254:0:11977:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789351260.641335:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8237986d-b9e8-417a-ac8f-a078390d268c+8:2347:x1876270617013248:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 446us (708us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789351260.641345:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00010000:00010000:2.0:1789351260.642463:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df786a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.642481:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df786a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.642491:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df786a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.642496:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351260.642501:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df786a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.642508:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df786a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.642525:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2ce9e1a800) 00010000:00010000:2.0:1789351260.642527:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351260.642531:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df786a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.642536:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df786a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351260.650201:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.651492:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617013504 00000100:00100000:3.0:1789351260.651511:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617013504 00000100:00100000:3.0:1789351260.651600:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 186 00000100:00100000:3.0:1789351260.651614:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+19:11485:x1876270617013504:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789351260.651711:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7871 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.651733:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7839 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f3c expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.651744:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7871 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.651792:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7839 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f3c expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.651810:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7839 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f3c expref: 19 pid: 5822 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351260.651829:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9ca1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876270626434176:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351260.651967:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc55e2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351260.655622:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351260.655667:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617013632 00000100:00100000:1.0:1789351260.655678:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617013632 00000100:00100000:2.0:1789351260.655703:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9ca1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876270626434176:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351260.655729:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7839 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f3c expref: 20 pid: 5822 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.655739:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7871 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351260.655780:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:1.0:1789351260.655792:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6581050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+20:2348:x1876270617013632:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351260.655808:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351260.655816:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7839 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f3c expref: 20 pid: 5822 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.655830:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7839 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f3c expref: 20 pid: 5822 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.655858:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7839 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f3c expref: 20 pid: 5822 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.655874:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2ce9e1a800) 00010000:00010000:1.0:1789351260.655879:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7871 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.655899:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7871 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.655907:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7871 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.655934:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351260.655948:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7871 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.655959:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7871 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.655990:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7871 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.655996:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7871 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.656001:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7871 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.656006:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351260.656009:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7871 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351260.656017:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6581050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+19:2348:x1876270617013632:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 223us (406us total) trans 0 rc 0/0 00010000:00010000:2.0:1789351260.656018:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7871 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.656031:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2ce9e1a800) 00000100:00100000:1.0:1789351260.656035:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 72 00010000:00010000:2.0:1789351260.656036:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789351260.656040:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7871 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.656045:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7871 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351260.656308:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+18:11485:x1876270617013504:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 Request processed in 4699us (6119us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789351260.656315:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 186 00000100:00100000:1.0:1789351260.660502:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351260.660586:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617013760 00000100:00100000:2.0:1789351260.660601:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617013760 00000100:00100000:2.0:1789351260.660675:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:2.0:1789351260.660686:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+8:2347:x1876270617013760:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789351260.660740:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000964023b5/0xa6ea017771df7878 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.660769:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7863 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f58 expref: 8 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.660780:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789351260.660785:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789351260.660790:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000964023b5/0xa6ea017771df7878 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.660833:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7863 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f58 expref: 8 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.660851:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7863 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f58 expref: 8 pid: 11977 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351260.660870:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6660:1876270626434304:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351260.660974:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc65ce480 going to sleep for 11 seconds 00000100:00100000:3.0:1789351260.665485:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.665535:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617013888 00000100:00100000:3.0:1789351260.665545:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617013888 00010000:00010000:3.0:1789351260.665594:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7863 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f58 expref: 9 pid: 11977 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351260.665649:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 73 00000100:00100000:3.0:1789351260.665662:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+9:2347:x1876270617013888:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351260.665701:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351260.665732:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7863 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f58 expref: 9 pid: 11977 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.665750:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7863 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f58 expref: 9 pid: 11977 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.665787:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789351260.665794:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789351260.665801:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000964023b5/0xa6ea017771df7878 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.665813:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000964023b5/0xa6ea017771df7878 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.665841:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351260.665907:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+9:2347:x1876270617013888:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 247us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351260.665917:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 73 00010000:00010000:2.0:1789351260.666162:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7863 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f58 expref: 8 pid: 11977 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351260.666178:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6660:1876270626434304:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351260.666207:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000964023b5/0xa6ea017771df7878 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.666219:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000964023b5/0xa6ea017771df7878 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.666226:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000964023b5/0xa6ea017771df7878 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.666254:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000964023b5/0xa6ea017771df7878 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.666264:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000964023b5/0xa6ea017771df7878 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.666272:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000964023b5/0xa6ea017771df7878 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.666277:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0a00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351260.666280:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000964023b5/0xa6ea017771df7878 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.666287:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000964023b5/0xa6ea017771df7878 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.666296:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000964023b5/0xa6ea017771df7878 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.666307:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000964023b5/0xa6ea017771df7878 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351260.666350:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270617013760:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 5667us (5866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351260.666379:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:1.0:1789351260.669625:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351260.669743:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617014144 00000100:00100000:2.0:1789351260.669755:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617014144 00000100:00100000:2.0:1789351260.669840:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 187 00000100:00100000:2.0:1789351260.669850:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+18:11485:x1876270617014144:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789351260.669949:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df787f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.669966:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df787f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.669977:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df787f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.670227:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7886 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.670240:0:10562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7847 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f43 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.670250:0:10562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7886 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.670295:0:10562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7847 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f43 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.670307:0:10562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7847 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f43 expref: 19 pid: 5824 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351260.670320:0:10562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10562:1876270626434432:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351260.670428:0:10562:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc65ce480 going to sleep for 11 seconds 00000100:00100000:1.0:1789351260.673173:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.673457:0:10562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10562:1876270626434432:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351260.673490:0:10562:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7886 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351260.673854:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617014272 00000100:00100000:0.0:1789351260.673862:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617014272 00010000:00010000:0.0:1789351260.673906:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7847 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f43 expref: 20 pid: 5824 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351260.674006:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:0.0:1789351260.674026:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+20:2347:x1876270617014272:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351260.674044:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351260.674052:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7847 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f43 expref: 20 pid: 5824 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.674066:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7847 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f43 expref: 20 pid: 5824 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.674102:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df7847 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f43 expref: 20 pid: 5824 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.674119:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2ce9e1a800) 00010000:00010000:0.0:1789351260.674125:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7886 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.674136:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7886 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.674144:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7886 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351260.674178:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351260.674251:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+19:2347:x1876270617014272:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 227us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351260.674258:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 74 00010000:00010000:2.0:1789351260.674320:0:10562:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7886 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.674329:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7886 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789351260.674576:0:10562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1789351260.674740:0:10562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1789351260.674793:0:10562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1789351260.674897:0:10562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10562:1876270626434560:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789351260.674965:0:10562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351260.675002:0:10562:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc65cee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789351260.675024:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626434560 00000100:00100000:2.0:1789351260.675029:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626434560 00000100:00100000:2.0:1789351260.675060:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789351260.675070:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10562:x1876270626434560:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789351260.675154:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10562:x1876270626434560:12345-0@lo:1000:mdt00_004.0 Request processed in 87us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351260.675160:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789351260.675200:0:10562:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1789351260.675208:0:10562:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2cc6f65880, transno 4294967315 00000100:00100000:2.0:1789351260.675222:0:10562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10562:1876270626434560:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1789351260.675677:0:10562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1789351260.675733:0:10562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10562:1876270626434688:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789351260.675767:0:10562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351260.675788:0:10562:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc65ceb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789351260.675805:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626434688 00000100:00100000:2.0:1789351260.675809:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626434688 00000100:00100000:2.0:1789351260.675833:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789351260.675841:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10562:x1876270626434688:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789351260.676024:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10562:x1876270626434688:12345-0@lo:1000:mdt00_004.0 Request processed in 182us (256us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789351260.676032:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789351260.676066:0:10562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10562:1876270626434688:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1789351260.676111:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7886 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676122:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7886 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676128:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7886 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676133:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351260.676136:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7886 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676142:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7886 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676162:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2ce9e1a800) 00010000:00010000:2.0:1789351260.676164:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789351260.676168:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7886 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676172:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7886 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676198:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df77bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676203:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df77bb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676209:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df77bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676213:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351260.676216:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df77bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676222:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df77bb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676229:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:2.0:1789351260.676232:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789351260.676235:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df77bb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676241:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df77bb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676272:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df788d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676285:0:10562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df77de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f27 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676292:0:10562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df788d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676313:0:10562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df77de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f27 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.676324:0:10562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df77de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f27 expref: 22 pid: 5824 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351260.676333:0:10562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10562:1876270626434816:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351260.676406:0:10562:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc65ceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789351260.680777:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351260.680892:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617014400 00000100:00100000:1.0:1789351260.680904:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617014400 00010000:00010000:1.0:1789351260.680954:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df77de lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f27 expref: 23 pid: 5824 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351260.680999:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00100000:1.0:1789351260.681011:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+23:2348:x1876270617014400:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351260.681029:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351260.681037:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df77de lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f27 expref: 23 pid: 5824 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.681063:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df77de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f27 expref: 23 pid: 5824 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.681128:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:1.0:1789351260.681134:0:6676:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df788d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.681145:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df788d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.681153:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df788d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351260.681174:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351260.681283:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+23:2348:x1876270617014400:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 273us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351260.681291:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 75 00010000:00010000:2.0:1789351260.682531:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df77de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f27 expref: 22 pid: 5824 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351260.682556:0:10562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10562:1876270626434816:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351260.682583:0:10562:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df788d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.682594:0:10562:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df788d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.682600:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df788d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.682628:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df788d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.682634:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df788d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.682641:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df788d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.682647:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351260.682652:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df788d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.682659:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df788d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.682673:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:2.0:1789351260.682676:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351260.682681:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df788d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.682956:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df788d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.682969:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df787f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.682975:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df787f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.682982:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df787f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.682992:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351260.682995:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df787f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.683001:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df787f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.683009:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:2.0:1789351260.683012:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789351260.683015:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df787f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351260.683020:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df787f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351260.683592:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+21:11485:x1876270617014144:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 13735us (13970us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789351260.683605:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 187 00000020:00080000:2.0:1789351260.683613:0:10562:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789351260.685339:0:11642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789351260.685349:0:11642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789351260.685915:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:0.0:1789351260.685938:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789351260.693175:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351260.693676:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617014656 00000100:00100000:3.0:1789351260.693699:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617014656 00000100:00100000:3.0:1789351260.693776:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:3.0:1789351260.693790:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf035d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+21:11485:x1876270617014656:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789351260.694837:0:5825:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789351260.694956:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1789351260.695020:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7894 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.695039:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7894 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.695052:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7894 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.695062:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7894 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.695069:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7894 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.695075:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7894 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.695399:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789351260.695764:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf035d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+23:11485:x1876270617014656:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 1973us (2596us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789351260.695776:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00000020:00080000:3.0:1789351260.695783:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789351260.695857:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351260.695865:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7894 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.695875:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351260.695879:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7894 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.695900:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7894 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.695917:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d2ce058f500) 00010000:00010000:3.0:1789351260.695920:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789351260.695926:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7894 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.695933:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7894 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351260.695952:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351260.695955:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351260.695957:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789351260.921297:0:12366:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789351260.921312:0:12366:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789351260.921452:0:12366:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1789351260.921463:0:12366:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789351261.009673:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.012695:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617014912 00000100:00100000:2.0:1789351261.012714:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617014912 00000100:00100000:2.0:1789351261.012873:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 188 00000100:00100000:2.0:1789351261.012887:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+23:11495:x1876270617014912:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351261.012915:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351261.012938:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df789b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f5f expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.013262:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df78a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.013278:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df78a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.013290:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df78a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351261.013303:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1789351261.013532:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df789b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f5f expref: 26 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.013551:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df78a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f5f expref: 25 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.013560:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:2.0:1789351261.013564:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789351261.013568:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1e00, rc 0) 00000100:00100000:2.0:1789351261.013644:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+25:11495:x1876270617014912:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 761us (3982us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1789351261.013652:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 188 00000100:00080000:0.0:1789351261.014558:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789351261.020633:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.022617:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617015040 00000100:00100000:2.0:1789351261.022632:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617015040 00000100:00100000:2.0:1789351261.022745:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 189 00000100:00100000:2.0:1789351261.022758:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+25:11495:x1876270617015040:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:2.0:1789351261.022843:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df78b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.022869:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df78b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.022882:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df78b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.022899:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.022906:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.022913:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.023219:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df78be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.023228:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df78be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.023235:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df78be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789351261.023274:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df78be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.023288:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df78b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.023296:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df78b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.023315:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df78b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.023322:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.023326:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df78b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.023334:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df78b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.023346:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:2.0:1789351261.023350:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351261.023354:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df78b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.024487:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df78b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.024502:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.024509:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.024516:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.024522:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.024526:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.024544:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.024556:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2ce9e1a800) 00010000:00010000:2.0:1789351261.024558:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351261.024562:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.024568:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.024584:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df78be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.024590:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df78be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.024595:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df78be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.024601:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.024603:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df78be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.024609:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df78be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.024616:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351261.024619:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351261.024622:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df78be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.024637:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df78be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351261.024742:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+25:11495:x1876270617015040:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 1983us (4115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351261.024753:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 189 00000100:00100000:2.0:1789351261.055126:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.055413:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617015296 00000100:00100000:0.0:1789351261.055424:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617015296 00000100:00100000:0.0:1789351261.055485:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 190 00000100:00100000:0.0:1789351261.055497:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+25:11498:x1876270617015296:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789351261.055518:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351261.055538:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df78c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f66 expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.055619:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df78cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.055634:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df78cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.055647:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df78cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.055663:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df78d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.055671:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df78d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.055678:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df78d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.055994:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df78da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056002:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df78da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056017:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df78da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351261.056029:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789351261.056140:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df78cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056149:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df78cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056156:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df78cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056163:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351261.056167:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df78cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056174:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df78cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056187:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:0.0:1789351261.056190:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351261.056195:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df78cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056202:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df78cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056213:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df78d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056220:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df78d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056233:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df78d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056238:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351261.056241:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df78d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056247:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df78d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056256:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2cc886ed00) 00010000:00010000:0.0:1789351261.056258:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351261.056261:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df78d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056268:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df78d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056312:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df78c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f66 expref: 28 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056327:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df78da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f66 expref: 27 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.056335:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc886e500) 00010000:00010000:0.0:1789351261.056338:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789351261.056341:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8800, rc 0) 00000100:00100000:0.0:1789351261.056437:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+27:11498:x1876270617015296:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 942us (1320us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1789351261.056455:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 190 00000100:00100000:0.0:1789351261.062224:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351261.064162:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617015424 00000100:00100000:1.0:1789351261.064175:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617015424 00000100:00100000:1.0:1789351261.064239:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 191 00000100:00100000:1.0:1789351261.064250:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+27:11498:x1876270617015424:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:1.0:1789351261.064319:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df78e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.064334:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df78e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.064346:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df78e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.064403:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df78e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.064410:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df78e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.064417:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df78e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.064425:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351261.064429:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df78e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.064437:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df78e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.064451:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc886e500) 00010000:00010000:1.0:1789351261.064455:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789351261.064459:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df78e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.064465:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df78e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351261.064536:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+27:11498:x1876270617015424:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 287us (2319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351261.064545:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 191 00000100:00100000:1.0:1789351261.068861:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351261.068936:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617015680 00000100:00100000:3.0:1789351261.068945:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617015680 00000100:00100000:3.0:1789351261.069047:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:3.0:1789351261.069058:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+27:11498:x1876270617015680:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1789351261.069297:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+28:11498:x1876270617015680:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 240us (442us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789351261.069305:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:1.0:1789351261.099047:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.100914:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617015936 00000100:00100000:2.0:1789351261.100928:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617015936 00000100:00100000:2.0:1789351261.101002:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 192 00000100:00100000:2.0:1789351261.101013:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+28:11033:x1876270617015936:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789351261.101038:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351261.101059:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df78ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f6d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.101173:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.101190:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df78da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f66 expref: 29 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.101199:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78f6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.101232:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df78da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f66 expref: 29 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.101246:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df78da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f66 expref: 29 pid: 10562 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351261.101273:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc47fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876270626434944:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351261.101429:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52000 going to sleep for 11 seconds 00000100:00100000:1.0:1789351261.107311:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.108633:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617016064 00000100:00100000:0.0:1789351261.108648:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617016064 00010000:00010000:0.0:1789351261.108696:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df78da lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f66 expref: 30 pid: 10562 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351261.108741:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:0.0:1789351261.108753:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7580000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+30:2348:x1876270617016064:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351261.108768:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351261.108776:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df78da lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f66 expref: 30 pid: 10562 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.108791:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df78da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f66 expref: 30 pid: 10562 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.108814:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc886e500) 00010000:00010000:0.0:1789351261.108819:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.108829:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.108836:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78f6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.108854:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351261.108916:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7580000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+30:2348:x1876270617016064:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 164us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351261.108934:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 76 00010000:00010000:2.0:1789351261.109259:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df78da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f66 expref: 29 pid: 10562 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351261.109277:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc47fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876270626434944:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351261.109301:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.109310:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.109316:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351261.109340:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789351261.109529:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df78ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f6d expref: 30 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.109553:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f6d expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.109560:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc886e500) 00010000:00010000:2.0:1789351261.109563:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789351261.109566:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1a00, rc 0) 00000100:00100000:2.0:1789351261.109613:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+29:11033:x1876270617015936:12345-192.168.201.52@tcp:101:bash.0 Request processed in 8599us (10571us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789351261.109627:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 192 00000100:00100000:1.0:1789351261.111796:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.111969:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617016320 00000100:00100000:0.0:1789351261.111980:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617016320 00000100:00100000:0.0:1789351261.112070:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 193 00000100:00100000:0.0:1789351261.112091:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+29:11033:x1876270617016320:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:0.0:1789351261.112428:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df7904 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.112445:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df7904 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.112458:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df7904 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789351261.112514:0:10562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1789351261.112545:0:10562:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027f2b640 reply state 0000000059d2ca47 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df7904 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351261.112554:0:10562:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789351261.112607:0:10562:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1789351261.112719:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+33:11033:x1876270617016320:12345-192.168.201.52@tcp:36:bash.0 Request processed in 638us (929us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1789351261.112727:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 193 00000020:00080000:0.0:1789351261.112732:0:10562:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789351261.115565:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.116063:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617016448 00000100:00100000:0.0:1789351261.116072:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617016448 00000100:00100000:0.0:1789351261.116136:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 194 00000100:00100000:0.0:1789351261.116147:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+33:11033:x1876270617016448:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789351261.116169:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351261.116204:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df790b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f74 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.116272:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df790b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f74 expref: 34 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.116286:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df790b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f74 expref: 34 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.116306:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc886e500) 00010000:00010000:0.0:1789351261.116309:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789351261.116321:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8e00, rc 0) 00000100:00100000:0.0:1789351261.116415:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+34:11033:x1876270617016448:12345-192.168.201.52@tcp:101:bash.0 Request processed in 269us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351261.116424:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 194 00010000:00010000:2.0:1789351261.116547:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df7904 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.116557:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df7904 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.116564:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df7904 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.116575:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.116579:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df7904 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.116587:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df7904 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.116598:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc886e500) 00010000:00010000:2.0:1789351261.116601:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351261.116605:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df7904 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.116611:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8000/0xa6ea017771df7904 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351261.119909:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.120296:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617016576 00000100:00100000:0.0:1789351261.120311:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617016576 00000100:00100000:0.0:1789351261.120450:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:0.0:1789351261.120461:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc47fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+7:11033:x1876270617016576:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789351261.120481:0:11341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351261.120504:0:11341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7912 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f7b expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789351261.120532:0:11341:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa7555c, atime: 0x6aa7555b, ctime: 0x6aa7555c, blocks: 0xb 00010000:00010000:0.0:1789351261.120557:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=205s v=(0 0) 00010000:00010000:0.0:1789351261.120562:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351261.120571:0:11341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7912 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f7b expref: 8 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.122181:0:11341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7912 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f7b expref: 8 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.122199:0:11341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8c00, rc 0) 00000100:00100000:0.0:1789351261.122288:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc47fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+8:11033:x1876270617016576:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1828us (2386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351261.122298:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:3.0:1789351261.125410:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.125515:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617016704 00000100:00100000:2.0:1789351261.125526:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617016704 00002000:00010000:2.0:1789351261.125564:0:6666:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1789351261.125568:0:6666:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cf9ca1180 with x1876270617016704 ext(0->18446744073709551615) 00002000:00010000:2.0:1789351261.125579:0:6666:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2cf9ca1180. 00000100:00100000:2.0:1789351261.125622:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:2.0:1789351261.125631:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8237986d-b9e8-417a-ac8f-a078390d268c+8:2349:x1876270617016704:12345-192.168.201.52@tcp:10:bash.0 00002000:00010000:2.0:1789351261.125882:0:6666:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789351261.125885:0:6666:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789351260 -> 1789351261 00002000:00010000:2.0:1789351261.125888:0:6666:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789351259 -> 1789351259 00002000:00010000:2.0:1789351261.125890:0:6666:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789351260 -> 1789351261 00002000:00010000:2.0:1789351261.125893:0:6666:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789351261.125962:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8237986d-b9e8-417a-ac8f-a078390d268c+9:2349:x1876270617016704:12345-192.168.201.52@tcp:10:bash.0 Request processed in 331us (602us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789351261.125969:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00002000:00010000:2.0:1789351261.125973:0:6666:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1789351261.125975:0:6666:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cf9ca1180 with x1876270617016704 ext(0->18446744073709551615) 00002000:00010000:2.0:1789351261.125979:0:6666:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2cf9ca1180. 00010000:00010000:3.0:1789351261.157313:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351261.182888:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.182965:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617016832 00000100:00100000:2.0:1789351261.182975:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617016832 00000100:00100000:2.0:1789351261.183030:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 195 00000100:00100000:2.0:1789351261.183039:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+33:11512:x1876270617016832:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:2.0:1789351261.183119:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7919 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183136:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7919 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183146:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7919 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183159:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7920 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183172:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183179:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183455:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7927 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183464:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183471:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789351261.183504:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183514:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7919 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183521:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7919 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183527:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7919 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183533:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.183537:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7919 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183545:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7919 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183560:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:2.0:1789351261.183563:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351261.183568:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7919 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183574:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7919 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183585:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183590:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7920 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183595:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183601:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.183603:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183609:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7920 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183615:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351261.183617:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351261.183619:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7920 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183624:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7920 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183645:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183651:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7927 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183657:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183662:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.183664:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183670:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7927 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183677:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc886e500) 00010000:00010000:2.0:1789351261.183679:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351261.183681:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7927 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.183686:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7927 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351261.183753:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+33:11512:x1876270617016832:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 715us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351261.183761:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 195 00000100:00100000:1.0:1789351261.223562:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.223664:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617017088 00000100:00100000:2.0:1789351261.223679:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617017088 00000100:00100000:2.0:1789351261.223761:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 196 00000100:00100000:2.0:1789351261.223786:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+33:11515:x1876270617017088:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351261.223806:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351261.223828:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df792e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f82 expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.223906:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7935 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.223921:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7935 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.223932:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7935 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.223947:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df793c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.223954:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df793c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.223960:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df793c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224299:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df7943 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224309:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df7943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224316:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df7943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351261.224339:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789351261.224472:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7935 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224480:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7935 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224487:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7935 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224492:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.224496:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7935 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224504:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7935 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224515:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:2.0:1789351261.224518:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351261.224523:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7935 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224529:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df7935 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224540:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df793c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224546:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df793c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224563:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df793c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224569:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.224572:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df793c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224578:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df793c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224586:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351261.224589:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351261.224592:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df793c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224597:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df793c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224646:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df792e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f82 expref: 36 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224661:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df7943 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f82 expref: 35 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.224669:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc886e500) 00010000:00010000:2.0:1789351261.224671:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789351261.224674:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0e00, rc 0) 00000100:00100000:2.0:1789351261.224753:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+35:11515:x1876270617017088:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 970us (1204us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1789351261.224770:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 196 00000100:00100000:1.0:1789351261.232121:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.232211:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617017216 00000100:00100000:0.0:1789351261.232222:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617017216 00000100:00100000:0.0:1789351261.232282:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 197 00000100:00100000:0.0:1789351261.232293:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+35:11515:x1876270617017216:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:0.0:1789351261.232380:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7951 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.232398:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78f6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f6d expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.232407:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7951 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.232439:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f6d expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.232453:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f6d expref: 35 pid: 5822 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351261.232484:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7256d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626435072:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789351261.232588:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc5e2f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351261.237538:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.237583:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7256d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626435072:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789351261.237623:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7951 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351261.237644:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617017472 00000100:00100000:3.0:1789351261.237654:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617017472 00000100:00100000:3.0:1789351261.237724:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:3.0:1789351261.237736:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+36:5580:x1876270617017472:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789351261.238182:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+37:5580:x1876270617017472:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 447us (658us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789351261.238192:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:2.0:1789351261.248469:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351261.251226:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617017600 00000100:00100000:1.0:1789351261.251253:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617017600 00010000:00010000:1.0:1789351261.251335:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f6d expref: 37 pid: 5822 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351261.251445:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 77 00000100:00100000:1.0:1789351261.251458:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+37:2347:x1876270617017600:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351261.251479:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351261.251488:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f6d expref: 37 pid: 5822 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.251504:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f6d expref: 37 pid: 5822 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.251542:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df78f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f6d expref: 37 pid: 5822 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.251565:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc886e500) 00010000:00010000:1.0:1789351261.251571:0:6676:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7951 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.251583:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.251627:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7951 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.251669:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351261.251756:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+36:2347:x1876270617017600:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 300us (4166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351261.251764:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 77 00010000:00010000:0.0:1789351261.252034:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.252046:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.252108:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.252117:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7951 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.252125:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7951 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.252132:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351261.252138:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7951 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.252147:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7951 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.252158:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc886e500) 00010000:00010000:0.0:1789351261.252170:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789351261.252176:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7951 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.252183:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7951 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351261.252241:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+35:11515:x1876270617017216:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 19949us (20134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351261.252251:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 197 00000100:00100000:1.0:1789351261.255269:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.255349:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617017856 00000100:00100000:2.0:1789351261.255402:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617017856 00000100:00100000:2.0:1789351261.255471:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:2.0:1789351261.255484:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+35:11515:x1876270617017856:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1789351261.255788:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+36:11515:x1876270617017856:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 306us (533us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789351261.255797:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:3.0:1789351261.365502:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.365675:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617018112 00000100:00100000:2.0:1789351261.365689:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617018112 00000100:00100000:2.0:1789351261.365808:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 198 00000100:00100000:2.0:1789351261.365821:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+36:11538:x1876270617018112:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:2.0:1789351261.365856:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351261.365884:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7958 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f89 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366013:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df795f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366029:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df795f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366044:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df795f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366059:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df7966 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366113:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df7966 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366120:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df7966 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366547:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df796d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366558:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df796d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366565:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df796d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351261.366577:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789351261.366692:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df795f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366700:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df795f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366707:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df795f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366714:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.366718:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df795f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366726:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df795f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366749:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:2.0:1789351261.366752:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351261.366757:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df795f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366764:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df795f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366778:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df7966 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366785:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df7966 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366790:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df7966 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366795:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.366798:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df7966 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366804:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df7966 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366811:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351261.366813:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351261.366816:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df7966 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366822:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0400/0xa6ea017771df7966 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366884:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1000/0xa6ea017771df7958 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f89 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366901:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df796d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f89 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.366909:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc886e500) 00010000:00010000:2.0:1789351261.366911:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789351261.366914:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0200, rc 0) 00000100:00100000:2.0:1789351261.367002:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+38:11538:x1876270617018112:12345-192.168.201.52@tcp:101:cat.0 Request processed in 1183us (1515us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789351261.367011:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 198 00000100:00100000:1.0:1789351261.372292:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351261.372404:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617018368 00000100:00100000:3.0:1789351261.372417:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617018368 00000100:00100000:3.0:1789351261.372489:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:3.0:1789351261.372501:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+38:11538:x1876270617018368:12345-192.168.201.52@tcp:35:cat.0 00000100:00100000:3.0:1789351261.372825:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+39:11538:x1876270617018368:12345-192.168.201.52@tcp:35:cat.0 Request processed in 325us (548us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789351261.372833:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 54 00000100:00100000:1.0:1789351261.394187:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351261.394285:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617018624 00000100:00100000:3.0:1789351261.394300:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617018624 00000100:00100000:3.0:1789351261.394424:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 199 00000100:00100000:3.0:1789351261.394438:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+39:11540:x1876270617018624:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:3.0:1789351261.394525:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789351261.394561:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df796d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f89 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.394585:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df7943 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f82 expref: 38 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.394627:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df790b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f74 expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.394638:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2cc886e500) 00010000:00010000:3.0:1789351261.394650:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351261.394680:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df797b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.394696:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df797b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.394707:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df797b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.394724:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7982 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.394731:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.394738:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.395270:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7989 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.395280:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7989 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.395287:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7989 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789351261.398555:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:3.0:1789351261.398693:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7990 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.398717:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7990 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.398730:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7990 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.398740:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7990 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.398747:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7990 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.398753:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7990 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.398831:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789351261.398862:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7989 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.398870:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7989 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.398877:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7989 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.398884:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351261.398889:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7989 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.398914:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7989 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.398928:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2ce058f100) 00010000:00010000:3.0:1789351261.398932:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789351261.398938:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7989 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.398944:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7989 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.398970:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df797b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.398986:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df797b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.398992:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df797b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.398996:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351261.398999:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df797b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.399005:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df797b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.399013:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:3.0:1789351261.399015:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351261.399017:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df797b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.399032:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105800/0xa6ea017771df797b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789351261.399043:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a27b5b9 reply state 00000000adf49ced transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351261.399053:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789351261.399197:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+38:11540:x1876270617018624:12345-192.168.201.52@tcp:36:rm.0 Request processed in 4756us (5019us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789351261.399207:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 199 00010000:00010000:2.0:1789351261.404756:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.404779:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7982 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.404788:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7982 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.404796:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.404802:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7982 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.404809:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7982 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.404827:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2ce058f500) 00010000:00010000:2.0:1789351261.404846:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351261.404851:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7982 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.404856:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105c00/0xa6ea017771df7982 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.405324:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789351261.405337:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7990 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.405346:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105000 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351261.405350:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7990 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.405368:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7990 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.405381:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d2ce058f100) 00010000:00010000:1.0:1789351261.405384:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789351261.405387:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7990 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.405394:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105000/0xa6ea017771df7990 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.405410:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351261.405420:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351261.405422:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351261.440218:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.440315:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617018880 00000100:00100000:0.0:1789351261.440329:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617018880 00000100:00100000:0.0:1789351261.440433:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 200 00000100:00100000:0.0:1789351261.440449:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+37:11546:x1876270617018880:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:0.0:1789351261.440482:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351261.440510:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7997 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f90 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.440681:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df799e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.440699:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df799e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.440711:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df799e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.440725:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df79a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.440732:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df79a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.440756:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df79a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789351261.441447:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789351261.441645:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df79ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.441657:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df79ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.441665:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df79ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.441707:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df799e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.441715:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df799e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.441722:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df799e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.441728:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351261.441733:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df799e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.441741:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df799e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.441755:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:0.0:1789351261.441758:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351261.441773:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df799e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.441779:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df799e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789351261.441793:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e54d048 reply state 0000000073d7eabd transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df79a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351261.441803:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789351261.441837:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df7997 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f90 expref: 40 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.441852:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df79ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f90 expref: 39 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.441861:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2cc886e300) 00010000:00010000:0.0:1789351261.441863:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789351261.441866:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9a00, rc 0) 00000100:00100000:0.0:1789351261.442093:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+40:11546:x1876270617018880:12345-192.168.201.52@tcp:101:bash.0 Request processed in 1645us (1891us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789351261.442103:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 200 00010000:00010000:2.0:1789351261.444992:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df79a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.445016:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df79a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.445026:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df79a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.445039:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.445045:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df79a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.445054:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df79a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.445087:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2cc886ec00) 00010000:00010000:2.0:1789351261.445091:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351261.445105:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df79a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.445113:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df79a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351261.447890:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351261.448177:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617019008 00000100:00100000:3.0:1789351261.448198:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617019008 00000100:00080000:0.0:1789351261.448260:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789351261.448292:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:3.0:1789351261.448307:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8237986d-b9e8-417a-ac8f-a078390d268c+7:2348:x1876270617019008:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789351261.448333:0:11977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351261.448597:0:11977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df79ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f97 expref: -99 pid: 11977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789351261.448635:0:11977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351261.448662:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=205s v=(0 0) 00010000:00010000:3.0:1789351261.448668:0:11977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351261.448680:0:11977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df79ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f97 expref: 8 pid: 11977 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.448704:0:11977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df79ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f97 expref: 8 pid: 11977 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.448746:0:11977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105800, rc 0) 00000100:00100000:3.0:1789351261.449053:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8237986d-b9e8-417a-ac8f-a078390d268c+8:2348:x1876270617019008:12345-192.168.201.52@tcp:101:bash.0 Request processed in 749us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351261.449061:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:3.0:1789351261.452403:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.452575:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617019136 00000100:00100000:2.0:1789351261.452608:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617019136 00000100:00100000:2.0:1789351261.452679:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:2.0:1789351261.452692:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+8:11546:x1876270617019136:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789351261.452716:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351261.452739:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7f9e expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.452781:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df79ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f97 expref: 9 pid: 11977 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.452791:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351261.452797:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351261.452803:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f9e expref: 9 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.452845:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df79ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f97 expref: 9 pid: 11977 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.452862:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df79ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f97 expref: 9 pid: 11977 timeout: 305 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351261.452879:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff970700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6660:1876270626435200:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351261.453003:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52180 going to sleep for 11 seconds 00000100:00100000:1.0:1789351261.457681:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.457784:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617019264 00000100:00100000:0.0:1789351261.457796:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617019264 00010000:00010000:0.0:1789351261.457852:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df79ba lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f97 expref: 10 pid: 11977 timeout: 305 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351261.457906:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:0.0:1789351261.457920:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7582680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+10:2348:x1876270617019264:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351261.457958:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351261.457989:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df79ba lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f97 expref: 10 pid: 11977 timeout: 305 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.458007:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df79ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f97 expref: 10 pid: 11977 timeout: 305 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.458039:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351261.458045:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351261.458055:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f9e expref: 10 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.458068:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f9e expref: 10 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.458127:0:5809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f9e expref: 10 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351261.458143:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7256d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5809:1876270626435328:192.168.201.52@tcp:105: 00010000:00010000:2.0:1789351261.458155:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bd1f249/0xa6ea017771df79ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f97 expref: 10 pid: 11977 timeout: 305 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351261.458183:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff970700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6660:1876270626435200:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351261.458228:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f9e expref: 9 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.458240:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0400, rc 0) 00000100:00100000:0.0:1789351261.458251:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc5e2f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789351261.458272:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+9:11546:x1876270617019136:12345-192.168.201.52@tcp:101:bash.0 Request processed in 5582us (5922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351261.458280:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:0.0:1789351261.460577:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7256d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5809:1876270626435328:192.168.201.52@tcp:105: 00010000:00010000:0.0:1789351261.460609:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351261.460671:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7582680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+8:2348:x1876270617019264:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 2754us (3005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351261.460683:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:3.0:1789351261.462539:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.462764:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617019520 00000100:00100000:0.0:1789351261.462776:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617019520 00000100:00100000:0.0:1789351261.462837:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:0.0:1789351261.462847:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+39:11546:x1876270617019520:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:0.0:1789351261.463434:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+40:11546:x1876270617019520:12345-192.168.201.52@tcp:35:bash.0 Request processed in 586us (904us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789351261.463444:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:1.0:1789351261.587251:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.587339:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617019648 00000100:00100000:2.0:1789351261.587355:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617019648 00000100:00100000:2.0:1789351261.587498:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 201 00000100:00100000:2.0:1789351261.587512:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+40:11562:x1876270617019648:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351261.587550:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351261.587580:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df79c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7fa5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.587677:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df79cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.587694:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df79cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.587710:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df79cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351261.587792:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1789351261.587816:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351261.587851:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df79cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.587885:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1800/0xa6ea017771df79c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fa5 expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.587909:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df79cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fa5 expref: 41 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.587919:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:2.0:1789351261.587923:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789351261.587927:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0e00, rc 0) 00000100:00100000:2.0:1789351261.588007:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+41:11562:x1876270617019648:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 498us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351261.588015:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 201 00000100:00100000:3.0:1789351261.592691:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351261.593029:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617019904 00000100:00100000:1.0:1789351261.593049:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617019904 00000100:00100000:1.0:1789351261.593151:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 202 00000100:00100000:1.0:1789351261.593166:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+41:11562:x1876270617019904:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789351261.593195:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351261.593225:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df79d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7fac expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.593393:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df79dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.593411:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df79dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.593424:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df79dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351261.593439:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789351261.593625:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df79d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fac expref: 44 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.593650:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df79dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fac expref: 43 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.593688:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2cc886e300) 00010000:00010000:1.0:1789351261.593692:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789351261.593697:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4200, rc 0) 00000100:00100000:1.0:1789351261.593793:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+43:11562:x1876270617019904:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 631us (1114us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789351261.593802:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 202 00000100:00100000:0.0:1789351261.597828:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351261.597916:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617020032 00000100:00100000:1.0:1789351261.597930:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617020032 00000100:00100000:1.0:1789351261.598015:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:1.0:1789351261.598029:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6582050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+43:2349:x1876270617020032:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351261.598050:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351261.598094:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4200/0xa6ea017771df79dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fac expref: 43 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.598116:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2cc886e300) 00010000:00010000:1.0:1789351261.598123:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351261.598191:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6582050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+42:2349:x1876270617020032:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 165us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351261.598200:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1789351261.598650:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.598702:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617020288 00000100:00100000:0.0:1789351261.598708:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617020288 00000100:00100000:0.0:1789351261.598752:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 203 00000100:00100000:0.0:1789351261.598761:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+42:11562:x1876270617020288:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789351261.598787:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351261.598806:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df79eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7fb3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.598938:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df79f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.598955:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df79f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.598968:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df79f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351261.598982:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789351261.599177:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df79eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fb3 expref: 45 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.599226:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df79f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fb3 expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.599235:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2cc886e300) 00010000:00010000:0.0:1789351261.599238:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789351261.599241:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9800, rc 0) 00000100:00100000:0.0:1789351261.599290:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+44:11562:x1876270617020288:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 531us (641us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789351261.599297:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 203 00000100:00100000:3.0:1789351261.604423:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.604525:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617020416 00000100:00100000:0.0:1789351261.604539:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617020416 00000100:00100000:0.0:1789351261.605132:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:0.0:1789351261.605145:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+8:2347:x1876270617020416:12345-192.168.201.52@tcp:1:lfs.0 00010000:00010000:0.0:1789351261.605203:0:11341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7a00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.605231:0:11341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f9e expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.605240:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789351261.605245:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789351261.605250:0:11341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7a00 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.605294:0:11341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f9e expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.605328:0:11341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f9e expref: 8 pid: 6660 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351261.605346:0:11341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7256d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11341:1876270626435456:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789351261.606143:0:11341:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2ad3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789351261.611669:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351261.611789:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617020544 00000100:00100000:1.0:1789351261.611805:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617020544 00002000:00100000:1.0:1789351261.611887:0:6667:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d2cc31d3480 x1876270617020544/t0(0) o4->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:517/0 lens 504/0 e 0 to 0 dl 1789351272 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1789351261.611902:0:11341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7256d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11341:1876270626435456:192.168.201.52@tcp:104: 00002000:00100000:1.0:1789351261.611903:0:6667:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cc31d3480 with x1876270617020544 ext(0->8) 00010000:00010000:1.0:1789351261.611919:0:6667:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f9e expref: 9 pid: 6660 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.611939:0:11341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7a00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.611977:0:6667:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f9e expref: 9 pid: 6660 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789351261.611988:0:6667:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d2cc31d3480 00000100:00100000:1.0:1789351261.612025:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:1.0:1789351261.612037:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8237986d-b9e8-417a-ac8f-a078390d268c+9:2347:x1876270617020544:12345-192.168.201.52@tcp:4:lfs.0 00000100:00100000:1.0:1789351261.616158:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8237986d-b9e8-417a-ac8f-a078390d268c+11:2347:x1876270617020544:12345-192.168.201.52@tcp:4:lfs.0 Request processed in 4104us (4485us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789351261.616175:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00002000:00100000:1.0:1789351261.616202:0:6667:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d2cc31d3480 x1876270617020544/t4294967308(0) o4->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:517/0 lens 504/448 e 0 to 0 dl 1789351272 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789351261.616214:0:6667:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cc31d3480 with x1876270617020544 ext(0->8) 00010000:00010000:1.0:1789351261.616228:0:6667:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f9e expref: 11 pid: 6660 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.616259:0:6667:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f9e expref: 11 pid: 6660 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789351261.616269:0:6667:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d2cc31d3480 00000100:00100000:3.0:1789351261.620014:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351261.620105:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617020672 00000100:00100000:1.0:1789351261.620118:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617020672 00010000:00010000:1.0:1789351261.620179:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f9e expref: 11 pid: 6660 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351261.620265:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00100000:1.0:1789351261.620280:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+11:2348:x1876270617020672:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351261.620304:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789351261.620332:0:5808:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789351261.620336:0:5808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789351261 00002000:00010000:1.0:1789351261.620338:0:5808:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789351261 00002000:00010000:1.0:1789351261.620340:0:5808:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789351261 00010000:00010000:1.0:1789351261.620347:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f9e expref: 11 pid: 6660 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.620586:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f9e expref: 11 pid: 6660 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.620634:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d53b5bc6/0xa6ea017771df79c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f9e expref: 11 pid: 6660 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.620666:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789351261.620671:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789351261.620678:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.620690:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7a00 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.620726:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789351261.620752:0:11341:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.620762:0:11341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.620791:0:11341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.620796:0:11341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7a00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.620803:0:11341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7a00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.620819:0:11341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8600 already unused, calling callback (ffffffffc1713fd0) 00000100:00100000:1.0:1789351261.620825:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+10:2348:x1876270617020672:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 545us (821us total) trans 0 rc 0/0 00010000:00010000:0.0:1789351261.620826:0:11341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7a00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351261.620842:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 79 00010000:00010000:0.0:1789351261.620843:0:11341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7a00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.620857:0:11341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7a00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.620862:0:11341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7a00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351261.621353:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+9:2347:x1876270617020416:12345-192.168.201.52@tcp:1:lfs.0 Request processed in 15766us (16501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351261.621401:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:2.0:1789351261.625022:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351261.625129:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617020928 00000100:00100000:3.0:1789351261.625142:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617020928 00000100:00100000:3.0:1789351261.625215:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:3.0:1789351261.625229:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf035fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+44:11562:x1876270617020928:12345-192.168.201.52@tcp:35:lfs.0 00000004:00010000:3.0:1789351261.625490:0:5826:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df79f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fb3 expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789351261.625778:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1789351261.625831:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1789351261.627430:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1789351261.627521:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.627547:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df79ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f90 expref: 48 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.627581:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a07 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.627650:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df79ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f90 expref: 48 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.627672:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df79ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f90 expref: 48 pid: 5824 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351261.627690:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7259f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1876270626435584:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351261.627818:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0c0f000 going to sleep for 11 seconds 00000100:00100000:3.0:1789351261.631657:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351261.631729:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617021056 00000100:00100000:1.0:1789351261.631752:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617021056 00000100:00100000:2.0:1789351261.631817:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7259f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1876270626435584:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351261.631852:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.631914:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df79ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f90 expref: 49 pid: 5824 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351261.631963:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:1.0:1789351261.631977:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+49:2347:x1876270617021056:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351261.631999:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351261.632008:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df79ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f90 expref: 49 pid: 5824 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.632022:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df79ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f90 expref: 49 pid: 5824 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.632052:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9a00/0xa6ea017771df79ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f90 expref: 49 pid: 5824 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.632086:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2cc886e300) 00010000:00010000:1.0:1789351261.632092:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.632105:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.632114:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a07 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.632167:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351261.632230:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.632236:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351261.632255:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+48:2347:x1876270617021056:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 280us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351261.632265:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 80 00000001:00080000:2.0:1789351261.632988:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1789351261.633663:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1789351261.633833:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff970700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876270626435712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789351261.634004:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351261.634121:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52600 going to sleep for 11 seconds 00000100:00100000:0.0:1789351261.634170:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626435712 00000100:00100000:0.0:1789351261.634815:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626435712 00000100:00100000:0.0:1789351261.634970:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789351261.634984:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5826:x1876270626435712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789351261.635144:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5826:x1876270626435712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 162us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351261.635153:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789351261.635266:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff970700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876270626435712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789351261.635897:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1789351261.635989:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff970700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876270626435840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789351261.636039:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351261.636082:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52180 going to sleep for 11 seconds 00000100:00100000:1.0:1789351261.636104:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626435840 00000100:00100000:1.0:1789351261.636113:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626435840 00000100:00100000:1.0:1789351261.636160:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789351261.636170:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5826:x1876270626435840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1789351261.636379:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789351261.636440:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5826:x1876270626435840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 270us (399us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789351261.636449:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789351261.636489:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff970700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1876270626435840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789351261.636561:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1789351261.636612:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.636624:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a07 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.636632:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.636638:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351261.636643:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.636661:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a07 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.636682:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2cc886e300) 00010000:00010000:3.0:1789351261.636685:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789351261.636691:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a07 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.636696:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a07 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789351261.637042:0:5826:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789351261.637610:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1789351261.637626:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 206083267009ns, next at 207083263591ns, rc = 0 00000001:00080000:3.0:1789351261.637636:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1789351261.637688:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2cc886e300) 00010000:00010000:3.0:1789351261.637692:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789351261.637702:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df79f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fb3 expref: 52 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351261.638352:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf035fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+51:11562:x1876270617020928:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 13121us (13337us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1789351261.638393:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00000020:00080000:3.0:1789351261.638401:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789351261.643608:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.644321:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617021184 00000100:00100000:2.0:1789351261.644337:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617021184 00000100:00100000:2.0:1789351261.644461:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 204 00000100:00100000:2.0:1789351261.644475:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+51:11562:x1876270617021184:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351261.644511:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351261.644546:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7a0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7fba expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.644633:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7a0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fba expref: 52 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.644652:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7a0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fba expref: 52 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.644677:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351261.644681:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789351261.644686:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1a00, rc 0) 00000100:00100000:2.0:1789351261.644775:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+52:11562:x1876270617021184:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 300us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351261.644782:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 204 00000100:00100000:0.0:1789351261.650799:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351261.650952:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617021440 00000100:00100000:3.0:1789351261.650966:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617021440 00000100:00100000:3.0:1789351261.651041:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:3.0:1789351261.651055:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+52:11562:x1876270617021440:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:3.0:1789351261.651461:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+53:11562:x1876270617021440:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 408us (688us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1789351261.651470:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 57 00000100:00100000:3.0:1789351261.706810:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351261.706960:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617021568 00000100:00100000:1.0:1789351261.706973:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617021568 00000100:00100000:1.0:1789351261.707048:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 205 00000100:00100000:1.0:1789351261.707062:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+53:11572:x1876270617021568:12345-192.168.201.52@tcp:34:lfs.0 00010000:00010000:1.0:1789351261.707191:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7a15 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707215:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7a15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707230:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7a15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707250:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7a1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707257:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7a1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707284:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7a1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707472:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7a23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707481:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7a23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707487:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7a23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789351261.707540:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7a23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707555:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7a15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707562:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7a15 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707569:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7a15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707576:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351261.707581:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7a15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707590:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7a15 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707605:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:1.0:1789351261.707615:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351261.707622:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7a15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707630:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7a15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707647:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7a1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707652:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7a1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707658:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7a1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707662:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351261.707664:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7a1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707670:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7a1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707676:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2cc3d1cf00) 00010000:00010000:1.0:1789351261.707678:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351261.707681:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7a1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707686:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7a1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707699:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7a23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707710:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7a23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707715:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7a23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707720:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351261.707723:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7a23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707729:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7a23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707737:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:1.0:1789351261.707739:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351261.707742:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7a23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.707747:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7a23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351261.707841:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+53:11572:x1876270617021568:12345-192.168.201.52@tcp:34:lfs.0 Request processed in 781us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351261.707850:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 205 00000100:00100000:1.0:1789351261.752254:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.752450:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617021824 00000100:00100000:2.0:1789351261.752464:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617021824 00000100:00100000:2.0:1789351261.752559:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 206 00000100:00100000:2.0:1789351261.752577:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+53:11575:x1876270617021824:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351261.752605:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351261.752631:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7a2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7fc1 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.752724:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7a31 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.752741:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7a31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.752754:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7a31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.752770:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.752778:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.752784:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.752951:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7a3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.752961:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7a3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.752991:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7a3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351261.753004:0:9467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789351261.753155:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7a31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.753164:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7a31 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.753171:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7a31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.753177:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.753182:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7a31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.753189:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7a31 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.753204:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:2.0:1789351261.753207:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351261.753213:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7a31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.753219:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7a31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.753235:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.753242:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.753254:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.753260:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.753263:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.753269:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.753278:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2ce9e1a800) 00010000:00010000:2.0:1789351261.753281:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351261.753283:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.753289:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.753351:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7a2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc1 expref: 56 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.753431:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7a3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc1 expref: 55 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.753439:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351261.753441:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789351261.753444:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0800, rc 0) 00000100:00100000:2.0:1789351261.753534:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+55:11575:x1876270617021824:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 962us (1295us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789351261.753554:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 206 00000100:00100000:0.0:1789351261.759589:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.761690:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617021952 00000100:00100000:2.0:1789351261.761711:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617021952 00000100:00100000:2.0:1789351261.761848:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 207 00000100:00100000:2.0:1789351261.761863:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+55:11575:x1876270617021952:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:2.0:1789351261.761961:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7a4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.761984:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7a4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.761999:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7a4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.762036:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7a4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.762045:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7a4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.762052:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7a4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.762059:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.762075:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7a4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.762084:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7a4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.762097:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351261.762117:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789351261.762124:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7a4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.762131:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7a4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351261.762234:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+55:11575:x1876270617021952:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 374us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351261.762242:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 207 00000100:00100000:0.0:1789351261.771255:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.771351:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617022208 00000100:00100000:2.0:1789351261.771407:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617022208 00000100:00100000:2.0:1789351261.771483:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:2.0:1789351261.771496:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+55:11575:x1876270617022208:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1789351261.771798:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+56:11575:x1876270617022208:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 304us (558us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1789351261.771806:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 58 00000100:00100000:1.0:1789351261.827448:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351261.828043:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617022464 00000100:00100000:3.0:1789351261.828056:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617022464 00000100:00100000:3.0:1789351261.828150:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 208 00000100:00100000:3.0:1789351261.828163:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+56:11585:x1876270617022464:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789351261.828259:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351261.828264:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789351261.828301:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df79cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fa5 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.828574:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:3.0:1789351261.828580:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351261.828663:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7fc8 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.828803:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7a5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.828820:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7a3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc1 expref: 56 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.828829:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7a5b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.828871:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7a3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc1 expref: 56 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.828907:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7a3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc1 expref: 56 pid: 9467 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351261.828924:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf725bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876270626435968:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351261.829085:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0c0fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789351261.834166:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf725bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876270626435968:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351261.834214:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7a5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351261.834986:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.835090:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617022592 00000100:00100000:0.0:1789351261.835099:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617022592 00010000:00010000:0.0:1789351261.835150:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7a3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc1 expref: 57 pid: 9467 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351261.835197:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:0.0:1789351261.835210:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7581180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+57:2347:x1876270617022592:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351261.835232:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351261.835239:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7a3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc1 expref: 57 pid: 9467 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.835252:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7a3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc1 expref: 57 pid: 9467 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.835281:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7a3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc1 expref: 57 pid: 9467 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.835298:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:0.0:1789351261.835304:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7a5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.835326:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7a5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.835335:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7a5b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.835402:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351261.835487:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7581180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+56:2347:x1876270617022592:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 279us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351261.835496:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 81 00010000:00010000:3.0:1789351261.835770:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7a5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.835780:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7a5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351261.835805:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789351261.836003:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc8 expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.836023:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7a5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc8 expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.836031:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:3.0:1789351261.836035:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789351261.836037:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104a00, rc 0) 00000100:00100000:3.0:1789351261.836092:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+56:11585:x1876270617022464:12345-192.168.201.52@tcp:101:bash.0 Request processed in 7932us (8665us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789351261.836111:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 208 00000100:00100000:1.0:1789351261.838411:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351261.838575:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617022848 00000100:00100000:3.0:1789351261.838589:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617022848 00000100:00100000:3.0:1789351261.838656:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 209 00000100:00100000:3.0:1789351261.838670:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+56:11585:x1876270617022848:12345-192.168.201.52@tcp:36:bash.0 00010000:00010000:3.0:1789351261.839055:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7a69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.839086:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7a69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.839099:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7a69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789351261.839160:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1789351261.839186:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdb7ffb2 reply state 000000000f92a2c0 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7a69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351261.839195:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789351261.839313:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+59:11585:x1876270617022848:12345-192.168.201.52@tcp:36:bash.0 Request processed in 646us (959us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789351261.839321:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 209 00000020:00080000:3.0:1789351261.839326:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789351261.841100:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7a69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.841120:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7a69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.841127:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7a69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.841135:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351261.841140:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7a69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.841170:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7a69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.841246:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351261.841250:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351261.841255:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7a69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.841262:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105200/0xa6ea017771df7a69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351261.841795:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.841867:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617022976 00000100:00100000:2.0:1789351261.841879:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617022976 00000100:00100000:2.0:1789351261.841947:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 210 00000100:00100000:2.0:1789351261.841958:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+58:11585:x1876270617022976:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789351261.841983:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351261.842002:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7a70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7fcf expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.842273:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.842291:0:10562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7a5b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc8 expref: 59 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.842299:0:10562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.842353:0:10562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7a5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc8 expref: 59 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.842569:0:10562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7a5b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc8 expref: 59 pid: 5823 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351261.842586:0:10562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff972d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10562:1876270626436096:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351261.842726:0:10562:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c520c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789351261.844811:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351261.844930:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617023104 00000100:00100000:3.0:1789351261.844940:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617023104 00010000:00010000:3.0:1789351261.844990:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7a5b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc8 expref: 60 pid: 5823 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351261.845035:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:3.0:1789351261.845063:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+60:2348:x1876270617023104:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351261.845092:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351261.845100:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7a5b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc8 expref: 60 pid: 5823 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.845115:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7a5b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc8 expref: 60 pid: 5823 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.845143:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:3.0:1789351261.845148:0:6676:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.845158:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.845167:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.845200:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351261.845399:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+60:2348:x1876270617023104:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 338us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351261.845407:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 82 00010000:00010000:2.0:1789351261.845657:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104a00/0xa6ea017771df7a5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fc8 expref: 59 pid: 5823 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351261.845679:0:10562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff972d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10562:1876270626436096:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351261.845706:0:10562:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.845716:0:10562:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.845722:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351261.845780:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789351261.845786:0:10562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351261.845812:0:10562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.845850:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7a70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fcf expref: 59 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.845865:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fcf expref: 58 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.845886:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351261.845889:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789351261.845891:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1200, rc 0) 00000100:00100000:2.0:1789351261.845926:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+58:11585:x1876270617022976:12345-192.168.201.52@tcp:101:bash.0 Request processed in 3970us (4136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351261.845933:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 210 00000100:00100000:1.0:1789351261.848808:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.849037:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617023360 00000100:00100000:2.0:1789351261.849049:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617023360 00000100:00100000:2.0:1789351261.849166:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:2.0:1789351261.849180:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+58:11585:x1876270617023360:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:2.0:1789351261.849553:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+59:11585:x1876270617023360:12345-192.168.201.52@tcp:35:bash.0 Request processed in 375us (758us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789351261.849561:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00000004:00080000:2.0:1789351261.858387:0:8179:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 206304024447ns, next at 207304020640ns, rc = 0 00000100:00100000:3.0:1789351261.858706:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cff972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626436224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789351261.858800:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351261.858839:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626436224 00000100:00100000:0.0:1789351261.858912:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626436224 00000100:00100000:0.0:1789351261.858979:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789351261.858991:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1876270626436224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789351261.859033:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789351261.859104:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1876270626436224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351261.859112:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789351261.859166:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cff972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626436224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789351261.859901:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876270626436736:0@lo:400:kworker.0 00000100:00100000:1.0:1789351261.859949:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351261.860570:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626436736 00000100:00100000:3.0:1789351261.860579:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626436736 00000100:00080000:3.0:1789351261.860611:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351261.860658:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789351261.860670:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd827dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876270626436736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351261.860742:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd827dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876270626436736:12345-0@lo:400:kworker.0 Request processed in 75us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351261.860749:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789351261.860800:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876270626436608:0@lo:400:kworker.0 00000100:00100000:3.0:1789351261.860832:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351261.860858:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789351261.860864:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876270626436480:0@lo:400:kworker.0 00000100:00100000:3.0:1789351261.860886:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351261.860920:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626436608 00000100:00100000:3.0:1789351261.860923:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626436608 00000100:00080000:3.0:1789351261.860938:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351261.860958:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626436480 00000100:00100000:3.0:1789351261.860961:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626436480 00000100:00100000:3.0:1789351261.860980:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789351261.860986:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876270626436608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351261.861021:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876270626436608:12345-0@lo:400:kworker.0 Request processed in 35us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351261.861027:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789351261.861060:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876270626436608:0@lo:400:kworker.0 00000100:00100000:3.0:1789351261.861097:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789351261.861105:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876270626436480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351261.861139:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876270626436480:12345-0@lo:400:kworker.0 Request processed in 35us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351261.861145:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789351261.861167:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876270626436480:0@lo:400:kworker.0 00000100:00100000:0.0:1789351261.861728:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626436352:0@lo:400:kworker.0 00000100:00100000:0.0:1789351261.861778:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351261.861833:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626436352 00000100:00100000:0.0:1789351261.861838:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626436352 00000100:00100000:0.0:1789351261.861876:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789351261.861884:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3287:x1876270626436352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351261.861925:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3287:x1876270626436352:12345-0@lo:400:kworker.0 Request processed in 42us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351261.861932:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789351261.861974:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626436352:0@lo:400:kworker.0 00000100:00100000:1.0:1789351261.862183:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876270626436736:0@lo:400:kworker.0 00000100:00100000:0.0:1789351261.886948:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351261.887051:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617023488 00000100:00100000:1.0:1789351261.887081:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617023488 00000100:00100000:1.0:1789351261.887156:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 211 00000100:00100000:1.0:1789351261.887167:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+59:11591:x1876270617023488:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789351261.887198:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351261.887223:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df7a7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7fd6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.887312:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7a85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.887331:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.887346:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351261.888539:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1789351261.888548:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789351261.888584:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.888621:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4a00/0xa6ea017771df7a7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fd6 expref: 61 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.888644:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7a85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fd6 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.888674:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:1.0:1789351261.888677:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789351261.888682:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5400, rc 0) 00000100:00100000:1.0:1789351261.888763:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+60:11591:x1876270617023488:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1597us (1829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351261.888772:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 211 00000100:00100000:0.0:1789351261.892578:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351261.893324:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617023616 00000100:00100000:3.0:1789351261.893340:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617023616 00000100:00100000:3.0:1789351261.893446:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 212 00000100:00100000:3.0:1789351261.893456:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+60:11591:x1876270617023616:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351261.893480:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351261.893502:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7fdd expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893588:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7a93 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893604:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7a93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893614:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7a93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893625:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7a9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893629:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7a9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893634:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7a9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893719:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7aa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893723:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893743:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351261.893784:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789351261.893787:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351261.893805:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893815:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893822:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7a93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893828:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7a93 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893833:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7a93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893839:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351261.893842:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7a93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893849:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7a93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893859:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:3.0:1789351261.893862:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351261.893866:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7a93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893881:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7a93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893896:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7a9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893902:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7a9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893907:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7a9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893913:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351261.893917:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7a9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893923:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7a9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893932:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2ce058f800) 00010000:00010000:3.0:1789351261.893934:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351261.893936:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7a9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893940:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7a9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893970:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7a8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fdd expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893985:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fdd expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351261.893999:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:3.0:1789351261.894002:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789351261.894005:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105400, rc 0) 00000100:00100000:3.0:1789351261.894097:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+61:11591:x1876270617023616:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 642us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351261.894102:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 212 00000100:00100000:0.0:1789351261.905537:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.905647:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.905682:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617023744 00000100:00100000:0.0:1789351261.905706:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617023744 00000100:00100000:0.0:1789351261.905782:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1789351261.905794:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+61:2350:x1876270617023744:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351261.905812:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351261.905844:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105400/0xa6ea017771df7aa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fdd expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.905863:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:0.0:1789351261.905869:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351261.905945:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+60:2350:x1876270617023744:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 152us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351261.905952:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1789351261.905981:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617024000 00000100:00100000:0.0:1789351261.905985:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617024000 00000100:00100000:0.0:1789351261.906014:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 213 00000100:00100000:0.0:1789351261.906020:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+60:11591:x1876270617024000:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789351261.906041:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351261.906060:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df7aa8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7fe4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.907478:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7aaf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.907502:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fcf expref: 61 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.907523:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7aaf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.907564:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fcf expref: 61 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.907583:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fcf expref: 61 pid: 10562 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351261.907599:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7255880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626436864:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789351261.907708:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2c64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789351261.909619:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7255880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1876270626436864:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789351261.909661:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7aaf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351261.910118:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.910159:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617024128 00000100:00100000:0.0:1789351261.910167:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617024128 00010000:00010000:0.0:1789351261.910268:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fcf expref: 62 pid: 10562 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351261.910457:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00100000:0.0:1789351261.910470:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7255880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+62:2348:x1876270617024128:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351261.910487:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351261.910496:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fcf expref: 62 pid: 10562 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.910522:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fcf expref: 62 pid: 10562 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.910552:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1200/0xa6ea017771df7a77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fcf expref: 62 pid: 10562 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.910569:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:0.0:1789351261.910574:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7aaf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.910585:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7aaf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.910594:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7aaf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.910621:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351261.910676:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7255880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+61:2348:x1876270617024128:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 208us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351261.910685:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 83 00010000:00010000:0.0:1789351261.910933:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7aaf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.910943:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7aaf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351261.910968:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789351261.911497:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df7aa8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fe4 expref: 62 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.911522:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7aaf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fe4 expref: 61 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.911528:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:0.0:1789351261.911530:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789351261.911532:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8400, rc 0) 00000100:00100000:0.0:1789351261.911567:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+61:11591:x1876270617024000:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 5548us (5920us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789351261.911572:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 213 00000100:00100000:0.0:1789351261.915191:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351261.915242:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617024384 00000100:00100000:0.0:1789351261.915256:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617024384 00000100:00100000:0.0:1789351261.915345:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:0.0:1789351261.915389:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6582c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+61:11591:x1876270617024384:12345-192.168.201.52@tcp:103:lfs.0 00010000:00010000:0.0:1789351261.915411:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351261.915450:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7a0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fba expref: 61 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351261.915474:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:0.0:1789351261.915481:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351261.915549:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6582c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8237986d-b9e8-417a-ac8f-a078390d268c+60:11591:x1876270617024384:12345-192.168.201.52@tcp:103:lfs.0 Request processed in 193us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351261.915556:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000001:00080000:1.0:1789351261.920419:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1789351261.920437:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1789351261.920469:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1789351261.920475:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1789351261.922509:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351261.923592:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617024512 00000100:00100000:1.0:1789351261.923606:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617024512 00000100:00100000:1.0:1789351261.923682:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 214 00000100:00100000:1.0:1789351261.923695:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+60:11591:x1876270617024512:12345-192.168.201.52@tcp:58:lfs.0 00010000:00010000:1.0:1789351261.923829:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7abd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.923851:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7abd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351261.923866:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7abd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789351261.924139:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789351261.924269:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+60:11591:x1876270617024512:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 575us (1772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351261.924279:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 214 00000100:00100000:0.0:1789351261.927527:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351261.928110:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617024640 00000100:00100000:2.0:1789351261.928125:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617024640 00000100:00100000:2.0:1789351261.928204:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 215 00000100:00100000:2.0:1789351261.928219:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+60:11591:x1876270617024640:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351261.928253:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351261.928288:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7ac4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7feb expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.928461:0:10562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7abd lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.928484:0:10562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7ac4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7feb expref: 61 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.928511:0:10562:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7abd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.928529:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7ac4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7feb expref: 61 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.928546:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351261.928550:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789351261.928555:0:10562:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7ac4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7feb expref: 61 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351261.928564:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0600, rc 0) 00000100:00100000:2.0:1789351261.928652:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+61:11591:x1876270617024640:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 436us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351261.928660:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 215 00000100:00100000:0.0:1789351262.123207:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351262.123309:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617024768 00000100:00100000:3.0:1789351262.123320:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617024768 00000100:00100000:3.0:1789351262.123415:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 264 00000100:00100000:3.0:1789351262.123427:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2347:x1876270617024768:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351262.123513:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2347:x1876270617024768:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 89us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351262.123520:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 264 00000100:00100000:0.0:1789351262.129087:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351262.129127:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351262.129163:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351262.129248:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617024896 00000100:00100000:3.0:1789351262.129258:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617024896 00000100:00100000:3.0:1789351262.129310:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617025024 00000100:00100000:3.0:1789351262.129314:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617025024 00000100:00100000:3.0:1789351262.129343:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:3.0:1789351262.129353:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8237986d-b9e8-417a-ac8f-a078390d268c+5:2348:x1876270617024896:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351262.129469:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8237986d-b9e8-417a-ac8f-a078390d268c+5:2348:x1876270617024896:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 117us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351262.129476:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 55 00000100:00100000:3.0:1789351262.129493:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:3.0:1789351262.129499:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8237986d-b9e8-417a-ac8f-a078390d268c+9:2347:x1876270617025024:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351262.129540:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8237986d-b9e8-417a-ac8f-a078390d268c+9:2347:x1876270617025024:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 41us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351262.129546:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00080000:3.0:1789351262.129561:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789351262.129782:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617025152 00000100:00100000:1.0:1789351262.129787:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617025152 00000100:00100000:1.0:1789351262.129837:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00100000:1.0:1789351262.129846:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2348:x1876270617025152:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789351262.129903:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2348:x1876270617025152:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 59us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351262.129910:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00080000:3.0:1789351262.130054:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789351262.178025:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789351262.753784:0:11642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789351262.753792:0:11642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789351262.753834:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 6 00000040:00080000:0.0:1789351262.753840:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789351262.753961:0:11642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7256680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11642:1876270626436992:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789351262.754132:0:11642:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2c640c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351262.757555:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351262.757719:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617025280 00000100:00100000:1.0:1789351262.757729:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617025280 00000100:00100000:0.0:1789351262.757794:0:11642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7256680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11642:1876270626436992:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789351262.757804:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 216 00000100:00100000:1.0:1789351262.757816:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+61:11593:x1876270617025280:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789351262.757847:0:5822:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789351262.757950:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+61:11593:x1876270617025280:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 135us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351262.757958:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 216 00000100:00100000:2.0:1789351262.762072:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351262.762165:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617025408 00000100:00100000:3.0:1789351262.762174:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617025408 00000100:00100000:3.0:1789351262.762227:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 217 00000100:00100000:3.0:1789351262.762235:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+61:11593:x1876270617025408:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789351262.762294:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7acb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762306:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7acb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762317:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7acb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762326:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7ad2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762331:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762335:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762350:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7ad9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762390:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762395:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351262.762428:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789351262.762431:0:10562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351262.762440:0:10562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762448:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7acb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762452:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7acb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762458:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7acb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762462:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351262.762465:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7acb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762469:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7acb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762721:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2cc3d1c800) 00010000:00010000:3.0:1789351262.762724:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351262.762728:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7acb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762740:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7acb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762751:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762754:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7ad2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762758:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762761:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351262.762763:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762767:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7ad2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762771:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8d2ce058f800) 00010000:00010000:3.0:1789351262.762772:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351262.762774:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7ad2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762777:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7ad2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762786:0:10562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762789:0:10562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7ad9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762796:0:10562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762799:0:10562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351262.762801:0:10562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762804:0:10562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7ad9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762808:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:3.0:1789351262.762809:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351262.762811:0:10562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7ad9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.762814:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7ad9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351262.762884:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+61:11593:x1876270617025408:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 648us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351262.762892:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 217 00000100:00100000:3.0:1789351262.765504:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351262.765788:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617025664 00000100:00100000:2.0:1789351262.765797:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617025664 00000100:00100000:2.0:1789351262.766001:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 218 00000100:00100000:2.0:1789351262.766010:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+61:11593:x1876270617025664:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789351262.766027:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351262.766043:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7ae0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7ff2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.766164:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7ae7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.766190:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.766200:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351262.766211:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789351262.766313:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.766321:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7ae7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.766328:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.766334:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351262.766338:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.766345:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7ae7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.766398:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351262.766402:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789351262.766408:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7ae7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.766424:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7ae7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.766476:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7ae0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ff2 expref: 63 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.766488:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2cc3d1c800) 00010000:00010000:2.0:1789351262.766490:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789351262.766495:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7ae0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ff2 expref: 63 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.766504:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0a00, rc 0) 00000100:00100000:2.0:1789351262.766556:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+62:11593:x1876270617025664:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 549us (1061us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1789351262.766561:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 218 00000100:00100000:0.0:1789351262.769761:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351262.769814:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617025792 00000100:00100000:2.0:1789351262.769823:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617025792 00000100:00100000:2.0:1789351262.769875:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 219 00000100:00100000:2.0:1789351262.769886:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+62:11593:x1876270617025792:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789351262.769920:0:9467:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789351262.770022:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+62:11593:x1876270617025792:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 137us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351262.770030:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 219 00000100:00100000:0.0:1789351262.773564:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351262.773670:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617026048 00000100:00100000:3.0:1789351262.773680:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617026048 00000100:00100000:3.0:1789351262.774078:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 220 00000100:00100000:3.0:1789351262.774090:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+62:11593:x1876270617026048:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351262.774110:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351262.774114:0:10562:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789351262.774151:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7a85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fd6 expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.774225:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:3.0:1789351262.774231:0:10562:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351262.774245:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7af5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d7ff9 expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789351262.774682:0:10562:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1789351262.775082:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7afc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.775095:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7afc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.775106:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7afc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.775154:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7af5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ff9 expref: 64 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.775233:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7afc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ff9 expref: 63 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.775242:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2ce058f800) 00010000:00010000:3.0:1789351262.775245:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789351262.775248:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104c00, rc 0) 00000100:00100000:3.0:1789351262.775381:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+63:11593:x1876270617026048:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1272us (1805us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789351262.775400:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 220 00000100:00100000:3.0:1789351262.778237:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351262.778641:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617026304 00000100:00100000:2.0:1789351262.778651:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617026304 00000100:00100000:2.0:1789351262.778740:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 221 00000100:00100000:2.0:1789351262.778761:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+63:11593:x1876270617026304:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789351262.778812:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351262.778835:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104c00/0xa6ea017771df7afc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7ff9 expref: 63 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.778852:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2ce058f800) 00010000:00010000:2.0:1789351262.778862:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351262.778881:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.778893:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.778902:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.778954:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7b11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xeca89a19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.778962:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7b11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xeca89a19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.778969:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7b11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xeca89a19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.779034:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.779041:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b0a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.779069:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.779075:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351262.779079:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.779087:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.779096:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:2.0:1789351262.779098:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351262.779102:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b0a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.779108:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.779118:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7b11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xeca89a19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.779125:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7b11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xeca89a19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.779130:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7b11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xeca89a19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.779135:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351262.779137:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7b11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xeca89a19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.779153:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7b11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xeca89a19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.779161:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xeca89a19 (ffff8d2ce9e1af00) 00010000:00010000:2.0:1789351262.779174:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351262.779177:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7b11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xeca89a19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.779184:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0000/0xa6ea017771df7b11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xeca89a19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351262.779252:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+62:11593:x1876270617026304:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 492us (1021us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789351262.779260:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 221 00000100:00100000:0.0:1789351262.781634:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351262.781876:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617026432 00000100:00100000:1.0:1789351262.781885:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617026432 00000100:00100000:2.0:1789351262.781937:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 222 00000100:00100000:2.0:1789351262.781948:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+62:11593:x1876270617026432:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789351262.781966:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351262.781988:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7b18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8000 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.782021:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7b1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.782035:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.782046:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.782192:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7b18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8000 expref: 64 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.782209:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7b1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8000 expref: 63 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.782218:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2ce9e1a000) 00010000:00010000:2.0:1789351262.782221:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789351262.782223:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1a00, rc 0) 00000100:00100000:2.0:1789351262.782272:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+63:11593:x1876270617026432:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 326us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351262.782279:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 222 00000100:00100000:3.0:1789351262.784777:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351262.784851:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617026688 00000100:00100000:2.0:1789351262.784860:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617026688 00000100:00100000:2.0:1789351262.784912:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 223 00000100:00100000:2.0:1789351262.784922:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+63:11593:x1876270617026688:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789351262.784996:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7b26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.785011:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7b26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.785022:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7b26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789351262.785392:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:2.0:1789351262.785495:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3331d18 reply state 000000002bd26dc8 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7b26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351262.785517:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789351262.785603:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+65:11593:x1876270617026688:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 681us (834us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1789351262.785612:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 223 00010000:00010000:1.0:1789351262.786839:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7b26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.786854:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7b26 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.786949:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7b26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.786956:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351262.786960:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7b26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.786978:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7b26 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.786992:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2ce9e1a000) 00010000:00010000:1.0:1789351262.786995:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789351262.786999:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7b26 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.787005:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7b26 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351262.787722:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351262.787905:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617026816 00000100:00100000:2.0:1789351262.787914:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617026816 00000100:00100000:2.0:1789351262.787992:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 224 00000100:00100000:2.0:1789351262.788002:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+64:11593:x1876270617026816:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789351262.788023:0:9467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351262.788039:0:9467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7b2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8007 expref: -99 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.788100:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7b2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8007 expref: 65 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.788113:0:9467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7b2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8007 expref: 65 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.788129:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2ce9e1a000) 00010000:00010000:2.0:1789351262.788132:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789351262.788135:0:9467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0c00, rc 0) 00000100:00100000:2.0:1789351262.788191:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+65:11593:x1876270617026816:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 190us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351262.788198:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 224 00000100:00100000:2.0:1789351262.790030:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351262.790136:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617026944 00000100:00100000:0.0:1789351262.790144:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617026944 00000100:00100000:0.0:1789351262.790230:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:0.0:1789351262.790241:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+9:2347:x1876270617026944:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789351262.790761:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+10:2347:x1876270617026944:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 521us (735us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789351262.790770:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:0.0:1789351262.792398:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351262.792480:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617027200 00000100:00100000:3.0:1789351262.792489:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617027200 00000100:00100000:3.0:1789351262.792531:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:3.0:1789351262.792539:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+65:11593:x1876270617027200:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789351262.792720:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+66:11593:x1876270617027200:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 181us (361us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1789351262.792727:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:2.0:1789351262.794070:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351262.794223:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617027456 00000100:00100000:0.0:1789351262.794230:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617027456 00000100:00100000:0.0:1789351262.794271:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 225 00000100:00100000:0.0:1789351262.794280:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+66:11593:x1876270617027456:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789351262.794385:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+66:11593:x1876270617027456:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 105us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351262.794399:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 225 00000100:00100000:2.0:1789351262.796219:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351262.796449:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617027584 00000100:00100000:3.0:1789351262.796457:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617027584 00000100:00100000:3.0:1789351262.796511:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 226 00000100:00100000:3.0:1789351262.796521:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+66:11593:x1876270617027584:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351262.796537:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351262.796557:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7b34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d800e expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.796620:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7b3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.796636:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7b3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.796648:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7b3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351262.796696:0:10562:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351262.796712:0:10562:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7b3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.796737:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7b34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d800e expref: 68 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.796755:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7b3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d800e expref: 67 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.796765:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2ce9e1a000) 00010000:00010000:3.0:1789351262.796768:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789351262.796771:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3105e00, rc 0) 00000100:00100000:3.0:1789351262.796830:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+67:11593:x1876270617027584:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 310us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351262.796837:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 226 00000100:00100000:3.0:1789351262.803017:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351262.803240:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617027712 00000100:00100000:0.0:1789351262.803250:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617027712 00000100:00100000:0.0:1789351262.803315:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:0.0:1789351262.803326:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+10:2348:x1876270617027712:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789351262.803343:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351262.803395:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7b42 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8015 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789351262.803424:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa7555e, blocks: 0x1 00010000:00010000:0.0:1789351262.803445:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=207s v=(0 0) 00010000:00010000:0.0:1789351262.803450:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351262.803461:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7b42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8015 expref: 11 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.803481:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7b42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8015 expref: 11 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.803496:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8e00, rc 0) 00000100:00100000:0.0:1789351262.803547:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+11:2348:x1876270617027712:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 223us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351262.803555:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:2.0:1789351262.805914:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351262.805995:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617027968 00000100:00100000:3.0:1789351262.806004:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617027968 00000100:00100000:3.0:1789351262.806066:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 227 00000100:00100000:3.0:1789351262.806076:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+67:11593:x1876270617027968:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789351262.806185:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+67:11593:x1876270617027968:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 110us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351262.806193:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 227 00000100:00100000:3.0:1789351262.809966:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351262.810048:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617028096 00000100:00100000:1.0:1789351262.810069:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617028096 00000100:00100000:1.0:1789351262.810159:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:1.0:1789351262.810174:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+11:11593:x1876270617028096:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789351262.810190:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351262.810205:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009133d5bd/0xa6ea017771df7b49 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d801c expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.810232:0:6663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7b42 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8015 expref: 12 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.810238:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789351262.810241:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789351262.810245:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009133d5bd/0xa6ea017771df7b49 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d801c expref: 12 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.810270:0:6663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7b42 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8015 expref: 12 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.810300:0:6663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7b42 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8015 expref: 12 pid: 6660 timeout: 307 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351262.810311:0:6663:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9ca1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6663:1876270626437120:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789351262.810429:0:6663:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc939bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351262.814416:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351262.814752:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617028224 00000100:00100000:0.0:1789351262.814761:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617028224 00010000:00010000:0.0:1789351262.814800:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7b42 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8015 expref: 13 pid: 6660 timeout: 307 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351262.814852:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:0.0:1789351262.814861:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+13:2348:x1876270617028224:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351262.814875:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351262.814896:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7b42 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8015 expref: 13 pid: 6660 timeout: 307 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.814910:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7b42 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8015 expref: 13 pid: 6660 timeout: 307 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.814933:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351262.814937:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351262.814945:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009133d5bd/0xa6ea017771df7b49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d801c expref: 13 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.814954:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009133d5bd/0xa6ea017771df7b49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d801c expref: 13 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.814987:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009133d5bd/0xa6ea017771df7b49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d801c expref: 13 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351262.815000:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7257800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5807:1876270626437248:192.168.201.52@tcp:105: 00000100:00100000:0.0:1789351262.815090:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2c640c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789351262.816972:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7257800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5807:1876270626437248:192.168.201.52@tcp:105: 00010000:00010000:0.0:1789351262.817006:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351262.817063:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+13:2348:x1876270617028224:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 2202us (2655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351262.817073:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 84 00010000:00010000:2.0:1789351262.817857:0:6663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7b42 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8015 expref: 12 pid: 6660 timeout: 307 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351262.817877:0:6663:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9ca1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6663:1876270626437120:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351262.817901:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009133d5bd/0xa6ea017771df7b49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d801c expref: 11 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.817914:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5e00, rc 0) 00000100:00100000:2.0:1789351262.817959:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+11:11593:x1876270617028096:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 7792us (7999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351262.817966:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:3.0:1789351262.822027:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351262.822338:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617028352 00000100:00100000:0.0:1789351262.822348:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617028352 00002000:00100000:0.0:1789351262.826459:0:6668:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8d2cf725aa00 x1876270617028352/t0(0) o4->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:518/0 lens 504/0 e 0 to 0 dl 1789351273 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789351262.826474:0:6668:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cf725aa00 with x1876270617028352 ext(0->12) 00002000:00010000:0.0:1789351262.826481:0:6668:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2cf725aa00 00000100:00100000:0.0:1789351262.826518:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:0.0:1789351262.826528:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8237986d-b9e8-417a-ac8f-a078390d268c+11:2348:x1876270617028352:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789351262.826958:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8237986d-b9e8-417a-ac8f-a078390d268c+13:2348:x1876270617028352:12345-192.168.201.52@tcp:4:lhsmtool_posix.0 Request processed in 430us (4939us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789351262.826965:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00002000:00100000:0.0:1789351262.826973:0:6668:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8d2cf725aa00 x1876270617028352/t4294967320(0) o4->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:518/0 lens 504/448 e 0 to 0 dl 1789351273 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789351262.826981:0:6668:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cf725aa00 with x1876270617028352 ext(0->12) 00002000:00010000:0.0:1789351262.826985:0:6668:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2cf725aa00 00000100:00100000:1.0:1789351262.830538:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351262.830797:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617028480 00000100:00100000:2.0:1789351262.830807:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617028480 00000100:00100000:2.0:1789351262.830900:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 228 00000100:00100000:2.0:1789351262.830911:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+67:11593:x1876270617028480:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789351262.862680:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+67:11593:x1876270617028480:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 31760us (32140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351262.862695:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 228 00000001:00080000:1.0:1789351262.863636:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000001:00080000:1.0:1789351262.863665:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1789351262.863676:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1789351262.863707:0:5844:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2cc6c52600 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789351262.863712:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d2cffb34e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2cc6c52cc0 00000020:00080000:1.0:1789351262.863715:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d2cffb34b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2cf7591400 00000020:00080000:1.0:1789351262.863749:0:5844:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2cc65cee40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789351262.863752:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d2cffb34800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2cc65ce600 00000020:00080000:1.0:1789351262.863755:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d2cffb34500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2cc6481c00 00000001:00080000:1.0:1789351262.863771:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1789351262.863791:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:2.0:1789351262.864086:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789351262.864104:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626437376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789351262.864157:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351262.864234:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626437504:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789351262.864259:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351262.864317:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626437376 00000100:00100000:2.0:1789351262.864325:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626437376 00000100:00100000:2.0:1789351262.864397:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626437504 00000100:00100000:2.0:1789351262.864401:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626437504 00000100:00100000:2.0:1789351262.864426:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789351262.864435:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1876270626437376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789351262.864459:0:11341:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1789351262.864484:0:11341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001830f7e5/0xa6ea017771df7b50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.864504:0:11341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7912 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f7b expref: 12 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.864512:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789351262.864517:0:11341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789351262.864521:0:11341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001830f7e5/0xa6ea017771df7b50 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.864549:0:11341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7912 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f7b expref: 12 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.864562:0:11341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7912 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f7b expref: 12 pid: 11341 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351262.864576:0:11341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11341:1876270626437632:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351262.864628:0:11341:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52900 going to sleep for 11 seconds 00000100:00100000:2.0:1789351262.864644:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789351262.864659:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626437504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789351262.864672:0:6660:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1789351262.864696:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa7555d, atime: 0x6aa7555d, ctime: 0x6aa7555d, blocks: 0xb 00010000:00010000:2.0:1789351262.864702:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef17c3d8/0xa6ea017771df7b57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.864711:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=207s v=(0 0) 00010000:00010000:2.0:1789351262.864713:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351262.864719:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef17c3d8/0xa6ea017771df7b57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.864734:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef17c3d8/0xa6ea017771df7b57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.864743:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef17c3d8/0xa6ea017771df7b57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.864751:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef17c3d8/0xa6ea017771df7b57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.864767:0:6660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789351262.865306:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626437504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 648us (1044us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789351262.865314:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1789351262.865336:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789351262.865353:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351262.865382:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef17c3d8/0xa6ea017771df7b57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.865397:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1800 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351262.865401:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef17c3d8/0xa6ea017771df7b57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.865411:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef17c3d8/0xa6ea017771df7b57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.865429:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef17c3d8/0xa6ea017771df7b57 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.865437:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef17c3d8/0xa6ea017771df7b57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.865455:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351262.865457:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351262.865459:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789351262.865488:0:3288:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1789351262.865494:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:2.0:1789351262.865513:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2cf9d8fb80, transno 4294967307 00000004:00080000:2.0:1789351262.865522:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:2.0:1789351262.865537:0:3288:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8d2cffadbb80 x1876270626437504/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789351278 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789351262.865548:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2cffadbb80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789351262.865553:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626437504:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1789351262.866274:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789351262.866430:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789351262.869759:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351262.870114:0:11341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11341:1876270626437632:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789351262.870143:0:11341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001830f7e5/0xa6ea017771df7b50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351262.870252:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351262.870371:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617028736 00000100:00100000:0.0:1789351262.870378:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617028736 00010000:00010000:0.0:1789351262.870410:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7912 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f7b expref: 13 pid: 11341 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351262.870450:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:0.0:1789351262.870460:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+13:2348:x1876270617028736:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351262.870474:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351262.870479:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7912 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f7b expref: 13 pid: 11341 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.870492:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7912 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f7b expref: 13 pid: 11341 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.870512:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7912 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f7b expref: 13 pid: 11341 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.870526:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789351262.870530:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789351262.870536:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001830f7e5/0xa6ea017771df7b50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.870545:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001830f7e5/0xa6ea017771df7b50 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.870581:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351262.870631:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+12:2348:x1876270617028736:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 172us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351262.870640:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:2.0:1789351262.870722:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617028608 00000100:00100000:2.0:1789351262.870734:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617028608 00000100:00100000:2.0:1789351262.870764:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:2.0:1789351262.870771:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+12:2347:x1876270617028608:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1789351262.874280:0:11341:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001830f7e5/0xa6ea017771df7b50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.874407:0:11341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001830f7e5/0xa6ea017771df7b50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.874420:0:11341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001830f7e5/0xa6ea017771df7b50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.874427:0:11341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001830f7e5/0xa6ea017771df7b50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.874448:0:11341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789351262.874977:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3286:x1876270626437376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10539us (10816us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789351262.874987:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1789351262.875018:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351262.875025:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001830f7e5/0xa6ea017771df7b50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.875033:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1000 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351262.875038:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001830f7e5/0xa6ea017771df7b50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.875058:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001830f7e5/0xa6ea017771df7b50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.875092:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001830f7e5/0xa6ea017771df7b50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.875100:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001830f7e5/0xa6ea017771df7b50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.875119:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351262.875121:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351262.875123:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789351262.875214:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2cf9ca1500/2, rc 0, transno 4294967321 00000100:00100000:2.0:1789351262.875232:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626437376:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789351262.894457:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:2.0:1789351262.894481:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:1.0:1789351262.894635:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270617028608:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 23858us (24879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351262.894647:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:1.0:1789351262.897945:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351262.898063:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617028992 00000100:00100000:0.0:1789351262.898072:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617028992 00000100:00100000:0.0:1789351262.898134:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 229 00000100:00100000:0.0:1789351262.898145:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+21:11593:x1876270617028992:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789351262.898461:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351262.898490:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105e00/0xa6ea017771df7b3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d800e expref: 21 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.898510:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2ce9e1a000) 00010000:00010000:0.0:1789351262.898514:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789351262.898547:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df7b5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.898559:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df7b5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.898569:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df7b5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789351262.898795:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a270e44a reply state 00000000f636f496 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df7b5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351262.898805:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789351262.899008:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+22:11593:x1876270617028992:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 863us (1070us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789351262.899017:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 229 00010000:00010000:1.0:1789351262.900159:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df7b5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.900232:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df7b5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.900239:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df7b5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.900245:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351262.900249:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df7b5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.900257:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df7b5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.900271:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2ce9e1a000) 00010000:00010000:1.0:1789351262.900274:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351262.900278:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df7b5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.900284:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df7b5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351262.901123:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351262.901388:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617029120 00000100:00100000:2.0:1789351262.901396:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617029120 00000100:00100000:2.0:1789351262.901443:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:2.0:1789351262.901453:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+7:2348:x1876270617029120:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789351262.901601:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789351262.901604:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789351262 00002000:00010000:2.0:1789351262.901605:0:6661:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789351261 00002000:00010000:2.0:1789351262.901606:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789351262 -> 1789351262 00002000:00010000:2.0:1789351262.901608:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789351262.901649:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8237986d-b9e8-417a-ac8f-a078390d268c+8:2348:x1876270617029120:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 197us (529us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789351262.901656:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:2.0:1789351262.903243:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351262.903280:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617029376 00000100:00100000:0.0:1789351262.903344:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617029376 00000100:00100000:0.0:1789351262.907382:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 230 00000100:00100000:0.0:1789351262.907397:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+21:11593:x1876270617029376:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789351262.907468:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7b65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.907486:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7b1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8000 expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.907496:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7b65 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.907530:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7b1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8000 expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.907544:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7b1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8000 expref: 21 pid: 5823 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351262.907559:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7257800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876270626437760:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789351262.907653:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6e13e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789351262.909632:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7257800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876270626437760:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789351262.909657:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7b65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351262.910929:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351262.911100:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617029504 00000100:00100000:3.0:1789351262.911109:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617029504 00010000:00010000:3.0:1789351262.911148:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7b1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8000 expref: 22 pid: 5823 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351262.911194:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 86 00000100:00100000:3.0:1789351262.911205:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffadad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+22:2348:x1876270617029504:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351262.911220:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351262.911226:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7b1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8000 expref: 22 pid: 5823 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.911239:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7b1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8000 expref: 22 pid: 5823 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.911260:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df7b1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8000 expref: 22 pid: 5823 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.911305:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2ce9e1a000) 00010000:00010000:3.0:1789351262.911311:0:6676:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7b65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.911322:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7b65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.911330:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7b65 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.911511:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351262.911533:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7b65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.911541:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7b65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351262.911559:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffadad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+21:2348:x1876270617029504:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 357us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351262.911567:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 86 00010000:00010000:2.0:1789351262.911577:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7b65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.911584:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7b65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.911591:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7b65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.911597:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351262.911601:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7b65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.911608:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7b65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.911618:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2ce9e1a000) 00010000:00010000:2.0:1789351262.911621:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789351262.911625:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7b65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.911631:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8800/0xa6ea017771df7b65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351262.911669:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+20:11593:x1876270617029376:12345-192.168.201.52@tcp:55:lhsmtool_posix.0 Request processed in 4275us (8432us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789351262.911677:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 230 00000100:00100000:1.0:1789351262.913272:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351262.913409:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617029632 00000100:00100000:2.0:1789351262.913416:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617029632 00000100:00100000:2.0:1789351262.913460:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:2.0:1789351262.913480:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+8:2347:x1876270617029632:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789351262.913519:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000084314b69/0xa6ea017771df7b6c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.913539:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009133d5bd/0xa6ea017771df7b49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d801c expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.913547:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351262.913551:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789351262.913556:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084314b69/0xa6ea017771df7b6c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.913587:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009133d5bd/0xa6ea017771df7b49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d801c expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.913602:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009133d5bd/0xa6ea017771df7b49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d801c expref: 8 pid: 6663 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351262.913617:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6660:1876270626437888:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351262.913681:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52780 going to sleep for 11 seconds 00000100:00100000:0.0:1789351262.915555:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6660:1876270626437888:192.168.201.52@tcp:104: 00010000:00010000:0.0:1789351262.915583:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000084314b69/0xa6ea017771df7b6c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351262.917221:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351262.917442:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617029760 00000100:00100000:0.0:1789351262.917452:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617029760 00010000:00010000:0.0:1789351262.917492:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009133d5bd/0xa6ea017771df7b49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d801c expref: 9 pid: 6663 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351262.917527:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:0.0:1789351262.917538:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+9:2347:x1876270617029760:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351262.917552:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351262.917574:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009133d5bd/0xa6ea017771df7b49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d801c expref: 9 pid: 6663 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.917587:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009133d5bd/0xa6ea017771df7b49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d801c expref: 9 pid: 6663 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.917612:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009133d5bd/0xa6ea017771df7b49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d801c expref: 9 pid: 6663 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.917627:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789351262.917632:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789351262.917637:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084314b69/0xa6ea017771df7b6c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.917665:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084314b69/0xa6ea017771df7b6c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.917702:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351262.917760:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+8:2347:x1876270617029760:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 223us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351262.917768:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 87 00010000:00010000:2.0:1789351262.917839:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000084314b69/0xa6ea017771df7b6c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.917850:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084314b69/0xa6ea017771df7b6c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.917888:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000084314b69/0xa6ea017771df7b6c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.917896:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084314b69/0xa6ea017771df7b6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.917904:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084314b69/0xa6ea017771df7b6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.917912:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0200 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351262.917916:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084314b69/0xa6ea017771df7b6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.917925:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084314b69/0xa6ea017771df7b6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.917938:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084314b69/0xa6ea017771df7b6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.917946:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084314b69/0xa6ea017771df7b6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351262.917991:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8237986d-b9e8-417a-ac8f-a078390d268c+7:2347:x1876270617029632:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 4513us (4723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351262.917998:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:2.0:1789351262.920698:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351262.920787:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617030016 00000100:00100000:1.0:1789351262.920796:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617030016 00000100:00100000:1.0:1789351262.920892:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 231 00000100:00100000:1.0:1789351262.920903:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+20:11593:x1876270617030016:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789351262.920996:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7b73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.921012:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7b73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.921025:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7b73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.921264:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7b7a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.921276:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7b2d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8007 expref: 21 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.921284:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7b7a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.921332:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7b2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8007 expref: 21 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.921345:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7b2d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8007 expref: 21 pid: 9467 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351262.921394:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec46300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876270626438016:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789351262.921468:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc939bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789351262.923565:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351262.923604:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617030144 00000100:00100000:3.0:1789351262.923611:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617030144 00010000:00010000:3.0:1789351262.923641:0:6676:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7b2d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8007 expref: 22 pid: 9467 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351262.923645:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec46300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876270626438016:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351262.923671:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7b7a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351262.923673:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:3.0:1789351262.923683:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+22:2348:x1876270617030144:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351262.923778:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351262.923785:0:6676:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7b2d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8007 expref: 22 pid: 9467 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.923794:0:6676:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7b2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8007 expref: 22 pid: 9467 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.923820:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0c00/0xa6ea017771df7b2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8007 expref: 22 pid: 9467 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.923832:0:6676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2ce9e1a000) 00010000:00010000:3.0:1789351262.923836:0:6676:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7b7a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.923842:0:6676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7b7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.923846:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7b7a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.923865:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351262.923905:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8237986d-b9e8-417a-ac8f-a078390d268c+21:2348:x1876270617030144:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 224us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351262.923910:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 88 00010000:00010000:1.0:1789351262.924296:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7b7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.924305:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7b7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789351262.924488:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1789351262.924617:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1789351262.924657:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1789351262.924730:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec46300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5822:1876270626438144:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789351262.924773:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351262.924807:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2ad3780 going to sleep for 11 seconds 00000100:00100000:0.0:1789351262.924947:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626438144 00000100:00100000:0.0:1789351262.924952:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626438144 00000100:00100000:0.0:1789351262.924989:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789351262.924997:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5822:x1876270626438144:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789351262.925089:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5822:x1876270626438144:12345-0@lo:1000:mdt00_000.0 Request processed in 91us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351262.925096:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789351262.925167:0:5822:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1789351262.925173:0:5822:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:2.0:1789351262.925193:0:5822:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8d2cf9ca1500 x1876270626437376/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789351278 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351262.925204:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec46300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5822:1876270626438144:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789351262.925659:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1789351262.925708:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5822:1876270626438272:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789351262.925738:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351262.925763:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52780 going to sleep for 11 seconds 00000100:00100000:0.0:1789351262.925861:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626438272 00000100:00100000:0.0:1789351262.925866:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626438272 00000100:00100000:0.0:1789351262.925885:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789351262.925892:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5822:x1876270626438272:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789351262.926036:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5822:x1876270626438272:12345-0@lo:1000:mdt00_000.0 Request processed in 143us (295us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789351262.926043:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789351262.926177:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5822:1876270626438272:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789351262.926204:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7b7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.926212:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7b7a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.926219:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7b7a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.926226:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351262.926230:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7b7a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.926238:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7b7a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.926252:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2ce9e1a000) 00010000:00010000:2.0:1789351262.926262:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789351262.926267:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7b7a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.926273:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7b7a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.926463:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7abd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.926470:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7abd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.926476:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7abd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.926480:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351262.926483:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7abd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.926488:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7abd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.926496:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351262.926498:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789351262.926504:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7ac4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7feb expref: 24 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.926514:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7ac4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7feb expref: 24 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.926520:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7ac4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7feb expref: 24 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.926551:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7ac4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7feb expref: 24 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351262.926561:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876270626438400:192.168.201.52@tcp:105: 00000100:00100000:2.0:1789351262.926657:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52780 going to sleep for 11 seconds 00000100:00100000:2.0:1789351262.928825:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351262.928909:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1876270626438400:192.168.201.52@tcp:105: 00010000:00010000:1.0:1789351262.928935:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7abd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.928944:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7abd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.928973:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b81 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.928985:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b81 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.928997:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b81 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.929006:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b81 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.929029:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b81 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.929035:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b81 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.929041:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351262.929045:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b81 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.929062:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b81 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.929072:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:1.0:1789351262.929076:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789351262.929079:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b81 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.929085:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b81 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.929096:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7b73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.929102:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7b73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.929107:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7b73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.929112:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351262.929121:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7b73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.929129:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7b73 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.929137:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:1.0:1789351262.929140:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789351262.929143:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7b73 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.929149:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df7b73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351262.929420:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+24:11593:x1876270617030016:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 8518us (8728us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1789351262.929430:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 231 00000020:00080000:1.0:1789351262.929437:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789351262.929628:0:11642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789351262.929633:0:11642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789351262.930114:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:0.0:1789351262.930122:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789351262.930390:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617030272 00000100:00100000:3.0:1789351262.930398:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617030272 00000100:00100000:3.0:1789351262.930449:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:3.0:1789351262.930459:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+24:11591:x1876270617030272:12345-192.168.201.52@tcp:49:lfs.0 00000100:00100000:3.0:1789351262.930574:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+24:11591:x1876270617030272:12345-192.168.201.52@tcp:49:lfs.0 Request processed in 116us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351262.930582:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 61 00000100:00100000:2.0:1789351262.933458:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351262.933539:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617030528 00000100:00100000:0.0:1789351262.933549:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617030528 00000100:00100000:0.0:1789351262.933604:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 232 00000100:00100000:0.0:1789351262.933614:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+24:11591:x1876270617030528:12345-192.168.201.52@tcp:58:lfs.0 00000040:00080000:0.0:1789351262.933985:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789351262.934082:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+24:11591:x1876270617030528:12345-192.168.201.52@tcp:58:lfs.0 Request processed in 469us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351262.934091:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 232 00000100:00100000:1.0:1789351262.938251:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351262.938397:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617030784 00000100:00100000:3.0:1789351262.938408:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617030784 00000100:00100000:3.0:1789351262.938467:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 62 00000100:00100000:3.0:1789351262.938495:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf035c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+24:11593:x1876270617030784:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789351262.939170:0:5826:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789351262.939270:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1789351262.941563:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.941585:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.941595:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.941604:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b88 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.941610:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b88 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.941616:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.941701:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789351262.941829:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf035c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+26:11593:x1876270617030784:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 3332us (3584us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789351262.941839:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 62 00000020:00080000:2.0:1789351262.941858:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789351262.943707:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351262.943719:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.943729:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0a00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351262.943733:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.943743:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.943759:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d2ce9e1a000) 00010000:00010000:3.0:1789351262.943762:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789351262.943767:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b88 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.943772:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7b88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351262.943791:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351262.943793:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351262.943794:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789351262.964725:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351262.965104:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617030912 00000100:00100000:0.0:1789351262.965114:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617030912 00000100:00100000:0.0:1789351262.965217:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 233 00000100:00100000:0.0:1789351262.965228:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+26:11595:x1876270617030912:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1789351262.965266:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351262.965290:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df7b8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8023 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.965392:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df7b96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.965406:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df7b96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.965418:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df7b96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.965465:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.965475:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.965483:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.965992:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7ba4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.966006:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7aaf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fe4 expref: 27 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.966023:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7ba4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.966068:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7aaf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fe4 expref: 27 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351262.966083:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7aaf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fe4 expref: 27 pid: 5824 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351262.966097:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876270626438528:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789351262.966310:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc604cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789351262.968347:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351262.968549:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617031168 00000100:00100000:2.0:1789351262.968786:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1876270626438528:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351262.968811:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7ba4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351262.969803:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617031168 00000100:00100000:1.0:1789351262.969913:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:1.0:1789351262.969923:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+28:5581:x1876270617031168:12345-192.168.201.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789351262.970174:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+29:5581:x1876270617031168:12345-192.168.201.52@tcp:35:ldlm_bl.0 Request processed in 251us (1834us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1789351262.970182:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 63 00000100:00100000:1.0:1789351262.972595:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351262.972949:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617031296 00000100:00100000:0.0:1789351262.973092:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617031296 00010000:00010000:0.0:1789351262.973130:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7aaf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fe4 expref: 29 pid: 5824 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351262.973190:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:0.0:1789351262.973200:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+29:2347:x1876270617031296:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351262.973215:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351262.973222:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7aaf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fe4 expref: 29 pid: 5824 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.973236:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7aaf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fe4 expref: 29 pid: 5824 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.973260:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7aaf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7fe4 expref: 29 pid: 5824 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.973276:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:0.0:1789351262.973281:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7ba4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.973290:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.973298:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7ba4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351262.973331:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351262.973418:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8237986d-b9e8-417a-ac8f-a078390d268c+28:2347:x1876270617031296:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 219us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351262.973426:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 89 00010000:00010000:2.0:1789351262.974460:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974471:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351262.974512:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789351262.974517:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351262.974535:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974550:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974561:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df7b96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974568:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df7b96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974576:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df7b96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974582:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9000 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351262.974587:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df7b96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974608:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df7b96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974619:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:2.0:1789351262.974622:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351262.974625:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df7b96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974632:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9000/0xa6ea017771df7b96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974646:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974652:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974658:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974663:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351262.974666:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974673:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974681:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d2cc886ea00) 00010000:00010000:2.0:1789351262.974683:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351262.974697:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974714:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df7b9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974752:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df7b8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8023 expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974765:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8023 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351262.974772:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351262.974775:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789351262.974777:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4400, rc 0) 00000100:00100000:2.0:1789351262.974829:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+27:11595:x1876270617030912:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 9602us (10114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351262.974838:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 233 00010000:00010000:2.0:1789351263.202463:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789351263.431300:0:12433:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789351263.431309:0:12433:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789351263.431393:0:12433:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 7 00000040:00080000:3.0:1789351263.431400:0:12433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789351263.969655:0:11642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789351263.969679:0:11642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789351263.969892:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789351263.969899:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789351263.970027:0:11642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7257800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11642:1876270626438656:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789351263.970164:0:11642:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc8a57180 going to sleep for 11 seconds 00000100:00100000:0.0:1789351263.972964:0:11642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7257800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11642:1876270626438656:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789351263.974256:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351263.974455:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617031424 00000100:00100000:1.0:1789351263.974463:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617031424 00000100:00100000:1.0:1789351263.974622:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 234 00000100:00100000:1.0:1789351263.974634:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+27:11607:x1876270617031424:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789351263.974669:0:5822:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789351263.974775:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+27:11607:x1876270617031424:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 143us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351263.974790:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 234 00000100:00080000:2.0:1789351263.974951:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789351263.978502:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351263.978587:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617031680 00000100:00100000:3.0:1789351263.978597:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617031680 00000100:00100000:3.0:1789351263.978662:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 235 00000100:00100000:3.0:1789351263.978672:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+27:11607:x1876270617031680:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351263.978692:0:10562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351263.978713:0:10562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7bab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d802a expref: -99 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351263.978816:0:10562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7bb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351263.978831:0:10562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351263.978843:0:10562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10562 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351263.978856:0:10562:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789351263.978983:0:10562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104200/0xa6ea017771df7bab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d802a expref: 30 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351263.979002:0:10562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d802a expref: 29 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351263.979010:0:10562:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:3.0:1789351263.979013:0:10562:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789351263.979017:0:10562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104600, rc 0) 00000100:00100000:3.0:1789351263.979096:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+29:11607:x1876270617031680:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 425us (603us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789351263.979119:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 235 00000100:00100000:3.0:1789351263.983877:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351263.983968:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617032064 00000100:00100000:0.0:1789351263.983980:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617032064 00000100:00100000:0.0:1789351263.984071:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:0.0:1789351263.984082:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6583050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+29:2347:x1876270617032064:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351263.984110:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351263.984137:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104600/0xa6ea017771df7bb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d802a expref: 29 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351263.984167:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:0.0:1789351263.984173:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351263.984233:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6583050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8237986d-b9e8-417a-ac8f-a078390d268c+28:2347:x1876270617032064:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 153us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351263.984240:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:0.0:1789351263.986572:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351263.986661:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617031936 00000100:00100000:2.0:1789351263.986671:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617031936 00000100:00100000:2.0:1789351263.986738:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 236 00000100:00100000:2.0:1789351263.986749:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+28:11607:x1876270617031936:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789351263.986825:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7bc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351263.986841:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7bc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351263.986852:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7bc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351263.987056:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7bc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351263.987065:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7bc0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351263.987072:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7bc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351263.987078:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351263.987082:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7bc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351263.987237:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7bc0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351263.987250:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:2.0:1789351263.987253:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789351263.987258:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7bc0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351263.987264:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7bc0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789351263.987665:0:11642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789351263.987670:0:11642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789351263.988207:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789351263.988215:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789351263.988320:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8237986d-b9e8-417a-ac8f-a078390d268c+29:11607:x1876270617031936:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 1570us (1754us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789351263.988330:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 236 00000100:00100000:1.0:1789351263.992137:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351263.992293:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617032320 00000100:00100000:3.0:1789351263.992304:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617032320 00000100:00100000:3.0:1789351263.992430:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 64 00000100:00100000:3.0:1789351263.992442:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+29:11607:x1876270617032320:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789351263.992668:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+30:11607:x1876270617032320:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 228us (539us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789351263.992677:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 64 00010000:00010000:3.0:1789351264.228386:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351264.930520:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789351264.930544:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626438784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789351264.930617:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351264.930726:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626438784 00000100:00100000:0.0:1789351264.930734:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626438784 00000100:00100000:0.0:1789351264.930793:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789351264.930805:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626438784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789351264.930840:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789351264.930895:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626438784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351264.930916:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789351264.930959:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626438784:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789351264.930966:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789351265.095191:0:12484:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789351265.095201:0:12484:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789351265.095245:0:12484:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789351265.095252:0:12484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789351265.212972:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351265.213171:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617032576 00000100:00100000:1.0:1789351265.213183:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617032576 00000100:00100000:1.0:1789351265.213894:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 237 00000100:00100000:1.0:1789351265.213907:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+30:11627:x1876270617032576:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1789351265.213931:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351265.213952:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7bc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8031 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351265.214063:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5200/0xa6ea017771df7bce lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351265.214076:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5200/0xa6ea017771df7bce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351265.214090:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5200/0xa6ea017771df7bce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351265.214102:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00080000:0.0:1789351265.215430:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789351265.215794:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5400/0xa6ea017771df7bc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8031 expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351265.215819:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5200/0xa6ea017771df7bce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8031 expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351265.215829:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:1.0:1789351265.215832:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789351265.215836:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5200, rc 0) 00000100:00100000:1.0:1789351265.215917:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8237986d-b9e8-417a-ac8f-a078390d268c+32:11627:x1876270617032576:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 2012us (2953us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789351265.215926:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 237 00000100:00100000:0.0:1789351265.223867:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351265.223905:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617032704 00000100:00100000:0.0:1789351265.223915:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617032704 00000100:00100000:0.0:1789351265.223965:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 238 00000100:00100000:0.0:1789351265.223975:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+32:11627:x1876270617032704:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:0.0:1789351265.224055:0:9467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7bdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351265.224071:0:9467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351265.224082:0:9467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351265.224109:0:9467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351265.224116:0:9467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7bdc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351265.224123:0:9467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7bdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351265.224129:0:9467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351265.224134:0:9467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7bdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351265.224147:0:9467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7bdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351265.224165:0:9467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:0.0:1789351265.224168:0:9467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789351265.224172:0:9467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7bdc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351265.224178:0:9467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df7bdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351265.224243:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+32:11627:x1876270617032704:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 269us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351265.224250:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 238 00010000:00010000:3.0:1789351265.249606:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351265.308544:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351265.308616:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617032832 00000100:00100000:1.0:1789351265.308628:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617032832 00000100:00100000:1.0:1789351265.308696:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00100000:1.0:1789351265.308710:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+7:2348:x1876270617032832:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:1.0:1789351265.308730:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351265.308751:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b15026e4/0xa6ea017771df7be3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8038 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789351265.308777:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa7555e, atime: 0x6aa7555d, ctime: 0x6aa7555e, blocks: 0xb 00010000:00010000:1.0:1789351265.308796:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=209s v=(0 0) 00010000:00010000:1.0:1789351265.308802:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789351265.308811:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b15026e4/0xa6ea017771df7be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8038 expref: 8 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351265.308828:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b15026e4/0xa6ea017771df7be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8038 expref: 8 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351265.308856:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5400, rc 0) 00000100:00100000:1.0:1789351265.308916:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+8:2348:x1876270617032832:12345-192.168.201.52@tcp:101:cat.0 Request processed in 211us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351265.308924:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 70 00000100:00080000:0.0:1789351265.309314:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789351265.311887:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351265.311995:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617032960 00000100:00100000:1.0:1789351265.312006:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617032960 00002000:00100000:1.0:1789351265.312074:0:6667:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8d2cf7256d80 x1876270617032960/t0(0) o3->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:521/0 lens 488/0 e 0 to 0 dl 1789351276 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789351265.312086:0:6667:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cf7256d80 with x1876270617032960 ext(0->4095) 00002000:00010000:1.0:1789351265.312091:0:6667:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2cf7256d80 00000100:00100000:1.0:1789351265.312126:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:1.0:1789351265.312137:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8237986d-b9e8-417a-ac8f-a078390d268c+8:2347:x1876270617032960:12345-192.168.201.52@tcp:3:cat.0 00000100:00100000:1.0:1789351265.312529:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8237986d-b9e8-417a-ac8f-a078390d268c+8:2347:x1876270617032960:12345-192.168.201.52@tcp:3:cat.0 Request processed in 393us (649us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789351265.312537:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00002000:00100000:1.0:1789351265.312545:0:6667:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8d2cf7256d80 x1876270617032960/t0(0) o3->8237986d-b9e8-417a-ac8f-a078390d268c@192.168.201.52@tcp:521/0 lens 488/4536 e 0 to 0 dl 1789351276 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789351265.312552:0:6667:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d2cf7256d80 with x1876270617032960 ext(0->4095) 00002000:00010000:1.0:1789351265.312556:0:6667:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d2cf7256d80 00010000:00010000:3.0:1789351266.276974:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351266.977552:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626438912:0@lo:400:kworker.0 00000100:00100000:1.0:1789351266.977590:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876270626439040:0@lo:400:kworker.0 00000100:00100000:0.0:1789351266.977627:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351266.977637:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351266.977680:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876270626439424:0@lo:400:kworker.0 00000100:00100000:0.0:1789351266.977697:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351266.977728:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626438912 00000100:00100000:0.0:1789351266.977734:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626438912 00000004:00080000:2.0:1789351266.977759:0:8179:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 211423399363ns, next at 212423396470ns, rc = 0 00000100:00100000:0.0:1789351266.977772:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789351266.977781:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3286:x1876270626438912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351266.977819:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626439552:0@lo:400:kworker.0 00000100:00100000:0.0:1789351266.977831:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3286:x1876270626438912:12345-0@lo:400:kworker.0 Request processed in 50us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351266.977841:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789351266.977941:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626439168:0@lo:400:kworker.0 00000100:00100000:3.0:1789351266.977962:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351266.977977:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626439680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789351266.978006:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351266.978029:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789351266.978036:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626439296:0@lo:400:kworker.0 00000100:00100000:3.0:1789351266.978068:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626439040 00000100:00100000:3.0:1789351266.978072:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626439040 00000100:00100000:3.0:1789351266.978104:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626439424 00000100:00100000:3.0:1789351266.978107:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626439424 00000100:00100000:3.0:1789351266.978127:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626439168 00000100:00100000:3.0:1789351266.978129:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626439168 00000100:00100000:3.0:1789351266.978142:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789351266.978147:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876270626439040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351266.978173:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351266.978182:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876270626439040:12345-0@lo:400:kworker.0 Request processed in 33us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351266.978188:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789351266.978203:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789351266.978210:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876270626439424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351266.978332:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626438912:0@lo:400:kworker.0 00000100:00100000:3.0:1789351266.978338:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876270626439424:12345-0@lo:400:kworker.0 Request processed in 128us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351266.978402:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876270626439424:0@lo:400:kworker.0 00000100:00080000:2.0:1789351266.978430:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351266.978438:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789351266.978453:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789351266.978461:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626439168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351266.978470:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876270626439040:0@lo:400:kworker.0 00000100:00100000:3.0:1789351266.978495:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626439168:12345-0@lo:400:kworker.0 Request processed in 35us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351266.978502:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789351266.978506:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626439552 00000100:00100000:1.0:1789351266.978511:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626439552 00000100:00100000:3.0:1789351266.978529:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789351266.978552:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789351266.978573:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626439680 00000100:00100000:2.0:1789351266.978577:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626439680 00000100:00100000:2.0:1789351266.978608:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789351266.978618:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3288:x1876270626439680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789351266.978645:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789351266.978682:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3288:x1876270626439680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351266.978689:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789351266.981733:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626439296 00000100:00100000:1.0:1789351266.981747:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626439296 00000100:00100000:0.0:1789351266.981751:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789351266.981766:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3287:x1876270626439552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351266.981811:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789351266.981823:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626439296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351266.981863:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3287:x1876270626439552:12345-0@lo:400:kworker.0 Request processed in 100us (3692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351266.981871:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789351266.981914:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626439296:0@lo:400:kworker.0 00000100:00100000:3.0:1789351266.981931:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626439168:0@lo:400:kworker.0 00000100:00100000:3.0:1789351266.981946:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626439680:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789351266.982011:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789351266.982055:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626439296:12345-0@lo:400:kworker.0 Request processed in 235us (3525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351266.982063:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789351266.982091:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626439552:0@lo:400:kworker.0 00000001:00080000:1.0:1789351267.058972:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:2.0:1789351267.247781:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351267.247834:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351267.247864:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617033088 00000100:00100000:1.0:1789351267.247876:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617033088 00000100:00100000:1.0:1789351267.247926:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 266 00000100:00100000:1.0:1789351267.247939:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd833a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2350:x1876270617033088:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789351267.248027:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd833a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2350:x1876270617033088:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351267.248034:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 266 00000100:00100000:2.0:1789351267.250231:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351267.250313:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617033344 00000100:00100000:2.0:1789351267.250326:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617033344 00000100:00100000:2.0:1789351267.250431:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:2.0:1789351267.250444:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:2350:x1876270617033344:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351267.250552:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:2350:x1876270617033344:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 111us (2717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351267.250561:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 59 00000100:00100000:2.0:1789351267.250593:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617033600 00000100:00100000:2.0:1789351267.250598:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617033600 00000100:00100000:2.0:1789351267.250635:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 98 00000100:00100000:2.0:1789351267.250642:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270617033600:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351267.250671:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2350:x1876270617033600:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 30us (2788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351267.250684:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 98 00000100:00080000:1.0:1789351267.251053:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789351267.251065:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789351267.251736:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351267.251801:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351267.252019:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617033216 00000100:00100000:0.0:1789351267.252032:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617033216 00000100:00080000:1.0:1789351267.252106:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789351267.252107:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 99 00000100:00100000:0.0:1789351267.252138:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+32:2350:x1876270617033216:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351267.252213:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8237986d-b9e8-417a-ac8f-a078390d268c+32:2350:x1876270617033216:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 80us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351267.252221:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 99 00000100:00100000:2.0:1789351267.252742:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617033472 00000100:00100000:2.0:1789351267.252749:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617033472 00000100:00100000:2.0:1789351267.252790:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00100000:2.0:1789351267.252798:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+8:2350:x1876270617033472:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351267.252838:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8237986d-b9e8-417a-ac8f-a078390d268c+8:2350:x1876270617033472:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 41us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351267.252845:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 60 00000100:00080000:2.0:1789351267.252873:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789351267.297549:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789351268.044224:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:1.0:1789351268.044238:0:5844:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1789351268.044251:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000004:00080000:1.0:1789351268.044285:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1789351268.044305:0:5844:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2cc6c52e40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789351268.044310:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d2cffb34900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2cc6c520c0 00000020:00080000:1.0:1789351268.044314:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d2cffb34400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2cef3a9000 00000020:00080000:1.0:1789351268.044336:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789351268.044532:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1789351268.044711:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626439808:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789351268.044800:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351268.044858:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626439808 00000100:00100000:1.0:1789351268.044867:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626439808 00000100:00100000:1.0:1789351268.044976:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789351268.044988:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3289:x1876270626439808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789351268.045155:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789351268.045159:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789351262 -> 1789351262 00002000:00010000:1.0:1789351268.045161:0:6661:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1789351261 -> 1789351261 00002000:00010000:1.0:1789351268.045164:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789351262 -> 1789351262 00002000:00010000:1.0:1789351268.045166:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789351268.045221:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3289:x1876270626439808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 235us (420us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789351268.045229:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789351268.045467:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789351268.047349:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2cf7259f80/2, rc 0, transno 4294967324 00000100:00100000:3.0:1789351268.047379:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626439808:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1789351268.084884:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1789351268.084902:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:2.0:1789351268.285843:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351268.286000:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617033728 00000100:00100000:0.0:1789351268.286011:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617033728 00000100:00100000:0.0:1789351268.286107:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 239 00000100:00100000:0.0:1789351268.286118:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+19:11268:x1876270617033728:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789351268.286226:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8237986d-b9e8-417a-ac8f-a078390d268c+19:11268:x1876270617033728:12345-192.168.201.52@tcp:60:lhsmtool_posix.0 Request processed in 109us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351268.286234:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 239 00000100:00100000:1.0:1789351268.289248:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351268.289654:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617033984 00000100:00100000:2.0:1789351268.289664:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617033984 00000100:00100000:2.0:1789351268.289814:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 65 00000100:00100000:2.0:1789351268.289827:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+19:11268:x1876270617033984:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789351268.290458:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8237986d-b9e8-417a-ac8f-a078390d268c+20:11268:x1876270617033984:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 634us (1220us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789351268.290464:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 65 00010000:00010000:3.0:1789351268.324032:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351268.445049:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351268.445162:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617034112 00000100:00100000:2.0:1789351268.445171:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617034112 00000100:00100000:2.0:1789351268.445822:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 240 00000100:00100000:2.0:1789351268.445834:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:12078:x1876270617034112:12345-192.168.201.52@tcp:101:lsof.0 00010000:00010000:2.0:1789351268.445856:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351268.445876:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7bea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d803f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351268.445968:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7bf1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351268.445983:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351268.445994:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351268.446182:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789351268.446187:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351268.447326:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351268.447374:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0a00/0xa6ea017771df7bea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d803f expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351268.447393:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d803f expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351268.447401:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc886e100) 00010000:00010000:2.0:1789351268.447403:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789351268.447407:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0800, rc 0) 00000100:00100000:2.0:1789351268.447478:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+6:12078:x1876270617034112:12345-192.168.201.52@tcp:101:lsof.0 Request processed in 1646us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351268.447486:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 240 00010000:00010000:3.0:1789351269.345604:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789351269.950966:0:12685:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:01:09 (1789351269) 00000100:00100000:2.0:1789351270.049658:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626439936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789351270.049739:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351270.049908:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626439936 00000100:00100000:0.0:1789351270.049917:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626439936 00000100:00100000:0.0:1789351270.050021:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789351270.050031:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626439936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789351270.050132:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789351270.050331:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626439936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 300us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351270.050346:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789351270.050471:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789351270.050583:0:3286:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789351270.050590:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2cffadbb80, transno 4294967310 00000100:00100000:1.0:1789351270.050642:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626439936:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789351270.373306:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351271.394020:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789351272.098447:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789351272.099969:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626440192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789351272.100033:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351272.100105:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789351272.100107:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626440192 00000100:00100000:3.0:1789351272.100113:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffa11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876270626440320:0@lo:400:kworker.0 00000100:00100000:1.0:1789351272.100116:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626440192 00000100:00100000:3.0:1789351272.100147:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351272.100180:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789351272.100189:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626440320 00000100:00100000:1.0:1789351272.100193:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626440192:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789351272.100195:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626440320 00000100:00100000:3.0:1789351272.100230:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00002000:00000024:1.0:1789351272.100239:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789351272.100240:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876270626440320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351272.100296:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876270626440320:12345-0@lo:400:kworker.0 Request processed in 59us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351272.100302:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626440192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351272.100308:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789351272.100314:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789351272.100351:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffa11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876270626440320:0@lo:400:kworker.0 00000100:00080000:1.0:1789351272.100353:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789351272.100400:0:3288:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1789351272.100406:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2cf9ca1500, transno 4294967321 00000004:00080000:3.0:1789351272.100426:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:3.0:1789351272.100447:0:3288:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8d2cf7259f80 x1876270626439808/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789351284 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351272.100473:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626440192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789351272.101273:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789351272.101286:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876270626440704:0@lo:400:kworker.0 00000100:00100000:0.0:1789351272.101329:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351272.101556:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876270626440448:0@lo:400:kworker.0 00000100:00100000:2.0:1789351272.101588:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351272.101615:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626440064:0@lo:400:kworker.0 00000100:00100000:2.0:1789351272.101643:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351272.101665:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789351272.101671:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626440576:0@lo:400:kworker.0 00000100:00100000:2.0:1789351272.101695:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351272.102014:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626440704 00000100:00100000:2.0:1789351272.102021:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626440704 00000100:00100000:2.0:1789351272.102060:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626440448 00000100:00100000:2.0:1789351272.102064:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626440448 00000100:00100000:2.0:1789351272.102084:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789351272.102092:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876270626440704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351272.102136:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876270626440704:12345-0@lo:400:kworker.0 Request processed in 44us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351272.102143:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789351272.102157:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789351272.102174:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876270626440448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351272.102206:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876270626440448:12345-0@lo:400:kworker.0 Request processed in 43us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351272.102213:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789351272.102231:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626440064 00000100:00100000:2.0:1789351272.102235:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626440064 00000100:00100000:2.0:1789351272.102270:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789351272.102288:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8339c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3286:x1876270626440064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351272.102324:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8339c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3286:x1876270626440064:12345-0@lo:400:kworker.0 Request processed in 39us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351272.102331:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789351272.102551:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876270626440704:0@lo:400:kworker.0 00000100:00100000:0.0:1789351272.102599:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626440576 00000100:00100000:0.0:1789351272.102603:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626440576 00000100:00100000:0.0:1789351272.102636:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789351272.102643:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626440576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351272.102685:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626440576:12345-0@lo:400:kworker.0 Request processed in 43us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351272.102691:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789351272.102801:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626440576:0@lo:400:kworker.0 00000100:00100000:3.0:1789351272.102818:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876270626440448:0@lo:400:kworker.0 00000100:00080000:1.0:1789351272.102821:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789351272.102829:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626440064:0@lo:400:kworker.0 00000100:00080000:1.0:1789351272.102829:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789351272.108720:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351272.110801:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617034368 00000100:00100000:3.0:1789351272.110815:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617034368 00000100:00100000:3.0:1789351272.110914:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:3.0:1789351272.110925:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+20:12298:x1876270617034368:12345-192.168.201.52@tcp:35:umount.0 00000100:00080000:1.0:1789351272.111266:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351272.111402:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+21:12298:x1876270617034368:12345-192.168.201.52@tcp:35:umount.0 Request processed in 478us (2690us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789351272.111410:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 66 00000100:00100000:1.0:1789351272.121885:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351272.122280:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617034624 00000100:00100000:3.0:1789351272.122291:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617034624 00000100:00100000:3.0:1789351272.122352:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:3.0:1789351272.122382:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+21:12298:x1876270617034624:12345-192.168.201.52@tcp:35:umount.0 00000100:00100000:3.0:1789351272.122753:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+22:12298:x1876270617034624:12345-192.168.201.52@tcp:35:umount.0 Request processed in 373us (877us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789351272.122761:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 67 00000100:00100000:1.0:1789351272.125452:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351272.125859:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617034880 00000100:00100000:3.0:1789351272.125868:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617034880 00000100:00100000:3.0:1789351272.125937:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:3.0:1789351272.125948:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf035f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+22:12298:x1876270617034880:12345-192.168.201.52@tcp:35:umount.0 00000100:00100000:3.0:1789351272.126502:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf035f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+23:12298:x1876270617034880:12345-192.168.201.52@tcp:35:umount.0 Request processed in 555us (1059us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789351272.126511:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 68 00000100:00100000:0.0:1789351272.135628:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351272.135691:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617035136 00000100:00100000:3.0:1789351272.135700:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617035136 00000100:00100000:3.0:1789351272.135751:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:3.0:1789351272.135760:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+23:12298:x1876270617035136:12345-192.168.201.52@tcp:35:umount.0 00000100:00100000:3.0:1789351272.136092:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8237986d-b9e8-417a-ac8f-a078390d268c+24:12298:x1876270617035136:12345-192.168.201.52@tcp:35:umount.0 Request processed in 332us (470us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789351272.136099:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 69 00000100:00100000:1.0:1789351272.139271:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351272.139324:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351272.139547:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617035264 00000100:00100000:2.0:1789351272.139557:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617035264 00000100:00100000:2.0:1789351272.139618:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617035392 00000100:00100000:2.0:1789351272.139622:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617035392 00000100:00100000:2.0:1789351272.139651:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:2.0:1789351272.139662:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:038b9b38-b2ec-45ac-958b-dad437feb5c7+14:2349:x1876270617035264:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789351272.139679:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351272.139698:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cf0f79a00/0xa6ea017771df6bf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bbc expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351272.139716:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789351272.139769:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:038b9b38-b2ec-45ac-958b-dad437feb5c7+13:2349:x1876270617035264:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 109us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351272.139776:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:2.0:1789351272.139793:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:2.0:1789351272.139801:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:2349:x1876270617035392:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789351272.139809:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351272.139816:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cf0f79200/0xa6ea017771df6b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7b84 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351272.139825:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789351272.139841:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:2349:x1876270617035392:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 42us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351272.139860:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:1.0:1789351272.142751:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351272.146824:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617035520 00000100:00100000:2.0:1789351272.146841:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617035520 00000100:00100000:2.0:1789351272.146935:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:2.0:1789351272.146954:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:2347:x1876270617035520:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789351272.146975:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351272.146997:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cc3104000/0xa6ea017771df6e68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c87 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351272.147018:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789351272.147092:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:2347:x1876270617035520:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 147us (4354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351272.147101:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:1.0:1789351272.147285:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351272.147727:0:11977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617035904 00000100:00100000:2.0:1789351272.147735:0:11977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617035904 00000100:00100000:2.0:1789351272.147794:0:11977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:2.0:1789351272.147803:0:11977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8237986d-b9e8-417a-ac8f-a078390d268c+7:2346:x1876270617035904:12345-192.168.201.52@tcp:9:umount.0 00000020:00000080:2.0:1789351272.147829:0:11977:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df7194 00000020:00010000:2.0:1789351272.147837:0:11977:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d2cc6fd3000: total 0 00000100:00080000:2.0:1789351272.147842:0:11977:0:(import.c:65:import_set_state_nolock()) ffff8d2cc6fd6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789351272.147882:0:11977:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1789351272.148124:0:11977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8237986d-b9e8-417a-ac8f-a078390d268c+5:2346:x1876270617035904:12345-192.168.201.52@tcp:9:umount.0 Request processed in 321us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351272.148132:0:11977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 72 00000020:00010000:2.0:1789351272.148155:0:5811:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d2cc6fd3000: total 0 00010000:00010000:2.0:1789351272.148177:0:5811:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8d2cc6fd3000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789351272.148240:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b15026e4/0xa6ea017771df7be3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8038 expref: 4 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351272.148274:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1d17c94/0xa6ea017771df753e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e63 expref: 3 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351272.148290:0:5811:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8d2cc6fd3000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789351272.148302:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351272.148305:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351272.148306:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789351272.148586:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789351272.154079:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351272.155401:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617036032 00000100:00100000:2.0:1789351272.155417:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617036032 00000100:00100000:2.0:1789351272.155523:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 73 00000100:00100000:2.0:1789351272.155537:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+5:2346:x1876270617036032:12345-192.168.201.52@tcp:9:umount.0 00000020:00000080:2.0:1789351272.155573:0:6663:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6f33 00000100:00080000:2.0:1789351272.155581:0:6663:0:(import.c:65:import_set_state_nolock()) ffff8d2cc517e800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789351272.155626:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789351272.155627:0:6663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:1.0:1789351272.155661:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789351272.155938:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8237986d-b9e8-417a-ac8f-a078390d268c+2:2346:x1876270617036032:12345-192.168.201.52@tcp:9:umount.0 Request processed in 404us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351272.155951:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 73 00000100:00100000:3.0:1789351272.167664:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351272.167951:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617037056 00000100:00100000:1.0:1789351272.167963:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617037056 00000100:00100000:1.0:1789351272.168033:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 241 00000100:00100000:1.0:1789351272.168043:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+24:2346:x1876270617037056:12345-192.168.201.52@tcp:39:umount.0 00000020:00000080:1.0:1789351272.168077:0:5824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6b5f 00000020:00010000:1.0:1789351272.168093:0:5824:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d2bc1e6d000: total 0 00000100:00080000:1.0:1789351272.168098:0:5824:0:(import.c:65:import_set_state_nolock()) ffff8d2bc1e69000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789351272.168129:0:5824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1789351272.168275:0:8417:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d2bc1e6d000: total 0 00010000:00010000:3.0:1789351272.168325:0:8417:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8d2bc1e6d000, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1789351272.168402:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:3.0:1789351272.168406:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789351272.168415:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1c00/0xa6ea017771df6f09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7cb1 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.168438:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:3.0:1789351272.168441:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789351272.168445:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df78a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7f5f expref: 22 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.168459:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc886e100) 00010000:00010000:3.0:1789351272.168461:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789351272.168480:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0030800/0xa6ea017771df75a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e7f expref: 21 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.168497:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:3.0:1789351272.168499:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789351272.168504:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0600/0xa6ea017771df7ac4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7feb expref: 20 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.168517:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:3.0:1789351272.168519:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789351272.168523:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df74f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e4e expref: 19 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.168535:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2cc3d1c800) 00010000:00010000:3.0:1789351272.168538:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351272.168542:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5c00/0xa6ea017771df6eb5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c9c expref: 18 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.168559:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:3.0:1789351272.168561:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789351272.168565:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4600/0xa6ea017771df7529 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e5c expref: 17 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.168578:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:3.0:1789351272.168580:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789351272.168584:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df7ba4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8023 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.168596:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d2ce058fb00) 00010000:00010000:3.0:1789351272.168604:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789351272.168609:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105600/0xa6ea017771df75bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e86 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.168627:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:3.0:1789351272.168629:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789351272.168633:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031400/0xa6ea017771df741f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e16 expref: 14 pid: 10562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.168647:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d2cc886e800) 00010000:00010000:3.0:1789351272.168649:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789351272.168653:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3105a00/0xa6ea017771df751b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7e55 expref: 13 pid: 9467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.168669:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:3.0:1789351272.168671:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789351272.168675:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc0031600/0xa6ea017771df71f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7d83 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.168700:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d2ce9e1a400) 00010000:00010000:3.0:1789351272.168704:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789351272.168708:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5200/0xa6ea017771df7bce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8031 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.168724:0:8417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2ce058fe00) 00010000:00010000:3.0:1789351272.168726:0:8417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789351272.168730:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cc3104800/0xa6ea017771df6e99 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c95 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.168754:0:8417:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8d2bc1e6d000, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1789351272.168768:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351272.168771:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351272.168772:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351272.169410:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8237986d-b9e8-417a-ac8f-a078390d268c+8:2346:x1876270617037056:12345-192.168.201.52@tcp:39:umount.0 Request processed in 1365us (1753us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789351272.169420:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 241 00000100:00100000:1.0:1789351272.363598:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351272.363666:0:9467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617037184 00000100:00100000:0.0:1789351272.363676:0:9467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617037184 00000100:00100000:0.0:1789351272.363764:0:9467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 103 00000100:00100000:0.0:1789351272.363776:0:9467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+6:2349:x1876270617037184:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351272.363863:0:9467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+6:2349:x1876270617037184:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351272.363872:0:9467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 103 00000100:00080000:1.0:1789351272.363952:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789351272.417660:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351272.946922:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351272.946971:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351272.947070:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351272.948485:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617037312 00000100:00100000:0.0:1789351272.948498:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617037312 00000100:00100000:0.0:1789351272.948566:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617037568 00000100:00100000:0.0:1789351272.948569:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617037568 00000100:00100000:0.0:1789351272.948585:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617037440 00000100:00100000:0.0:1789351272.948600:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617037440 00000100:00100000:0.0:1789351272.948623:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:0.0:1789351272.948633:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7580e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:038b9b38-b2ec-45ac-958b-dad437feb5c7+12:2347:x1876270617037312:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351272.948649:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351272.948669:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ceecd9200/0xa6ea017771df6ca1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bd1 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351272.948689:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00010000:00010000:0.0:1789351272.948689:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351272.948702:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:038b9b38-b2ec-45ac-958b-dad437feb5c7+11:2347:x1876270617037568:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351272.948712:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351272.948723:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df6e61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7c80 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.948735:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351272.948751:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7580e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:2347:x1876270617037312:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 118us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351272.948759:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:038b9b38-b2ec-45ac-958b-dad437feb5c7+10:2347:x1876270617037568:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 58us (1785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351272.948765:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:3.0:1789351272.948833:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:3.0:1789351272.948851:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:3.0:1789351272.948870:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:038b9b38-b2ec-45ac-958b-dad437feb5c7+8:2347:x1876270617037440:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351272.948878:0:6676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351272.948943:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cf0f78400/0xa6ea017771df6ca8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bfb expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.948954:0:6676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351272.948976:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:038b9b38-b2ec-45ac-958b-dad437feb5c7+7:2347:x1876270617037440:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 119us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351272.948991:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:3.0:1789351272.949603:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351272.950184:0:10562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617037824 00000100:00100000:1.0:1789351272.950202:0:10562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617037824 00000100:00100000:1.0:1789351272.950255:0:10562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 242 00000100:00100000:1.0:1789351272.950265:0:10562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffa11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+6:2346:x1876270617037824:12345-192.168.201.52@tcp:39:umount.0 00000020:00000080:1.0:1789351272.950301:0:10562:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6cb6 00000020:00010000:1.0:1789351272.950310:0:10562:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d2cffa1b800: total 0 00000100:00080000:1.0:1789351272.950314:0:10562:0:(import.c:65:import_set_state_nolock()) ffff8d2cffa1d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789351272.950345:0:10562:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1789351272.950561:0:10562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffa11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d53186e-ebf3-44d4-99b7-0a4ed0545c2b+5:2346:x1876270617037824:12345-192.168.201.52@tcp:39:umount.0 Request processed in 298us (957us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1789351272.950570:0:10562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 242 00000020:00010000:3.0:1789351272.950720:0:5810:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d2cffa1b800: total 0 00010000:00010000:3.0:1789351272.950724:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351272.950766:0:5810:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8d2cffa1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789351272.950795:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc886e100) 00010000:00010000:3.0:1789351272.950799:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789351272.950806:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df7bf1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d803f expref: 4 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351272.950827:0:5810:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8d2cffa1b800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789351272.950838:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351272.950841:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351272.950843:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351272.965904:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351272.966047:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617038080 00000100:00100000:1.0:1789351272.966058:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617038080 00000100:00100000:1.0:1789351272.966180:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 268 00000100:00100000:1.0:1789351272.966201:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cd8338c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+7:2346:x1876270617038080:12345-192.168.201.52@tcp:251:umount.0 00000020:00000080:1.0:1789351272.966249:0:5814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6b3c 00000020:00010000:1.0:1789351272.966256:0:5814:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d2bc1e68000: total 0 00000100:00080000:1.0:1789351272.966261:0:5814:0:(import.c:65:import_set_state_nolock()) ffff8d2bc1e6c000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789351272.966354:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cd8338c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:038b9b38-b2ec-45ac-958b-dad437feb5c7+3:2346:x1876270617038080:12345-192.168.201.52@tcp:251:umount.0 Request processed in 163us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351272.966394:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 268 00000020:00010000:2.0:1789351272.966539:0:8417:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d2bc1e68000: total 0 00010000:00010000:2.0:1789351272.966585:0:8417:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8d2bc1e68000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789351272.966620:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cf0f78200/0xa6ea017771df6c00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d7bc3 expref: 2 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351272.966638:0:8417:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8d2bc1e68000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789351272.966649:0:8417:0:(genops.c:906:class_export_put()) final put ffff8d2bc1e68000/038b9b38-b2ec-45ac-958b-dad437feb5c7 00010000:00010000:2.0:1789351272.967565:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351272.967569:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351272.967570:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789351272.967619:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2bc1e68000/038b9b38-b2ec-45ac-958b-dad437feb5c7 for MGS 00000020:00000080:0.0:1789351272.967849:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2bc1e6c000 for MGS 00000001:00080000:0.0:1789351273.163214:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00100000:0.0:1789351273.163232:0:7616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8237986d-b9e8-417a-ac8f-a078390d268c 00000020:00000080:0.0:1789351273.163236:0:7616:0:(genops.c:906:class_export_put()) final put ffff8d2cc6fd3000/8237986d-b9e8-417a-ac8f-a078390d268c 00000020:00000080:3.0:1789351273.163742:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cc6fd3000/8237986d-b9e8-417a-ac8f-a078390d268c for lustre-OST0001 00000020:00000080:3.0:1789351273.163793:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2cc6fd6800 for lustre-OST0001 00000001:00100000:1.0:1789351273.170587:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8d53186e-ebf3-44d4-99b7-0a4ed0545c2b 00000001:00080000:1.0:1789351273.170606:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1789351273.170611:0:5844:0:(genops.c:906:class_export_put()) final put ffff8d2cffa1b800/8d53186e-ebf3-44d4-99b7-0a4ed0545c2b 00000001:00100000:1.0:1789351273.170630:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8237986d-b9e8-417a-ac8f-a078390d268c 00000020:00000080:2.0:1789351273.170648:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cffa1b800/8d53186e-ebf3-44d4-99b7-0a4ed0545c2b for lustre-MDT0000 00000020:00000080:2.0:1789351273.170707:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2cffa1d000 for lustre-MDT0000 00000001:00080000:1.0:1789351273.170775:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00080000:1.0:1789351273.170780:0:5844:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00000080:1.0:1789351273.170807:0:5844:0:(genops.c:906:class_export_put()) final put ffff8d2bc1e6d000/8237986d-b9e8-417a-ac8f-a078390d268c 00000020:00080000:0.0:1789351273.170813:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789351273.170823:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00000080:3.0:1789351273.170851:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2bc1e6d000/8237986d-b9e8-417a-ac8f-a078390d268c for lustre-MDT0000 00000020:00000080:3.0:1789351273.170912:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2bc1e69000 for lustre-MDT0000 00000040:00080000:3.0:1789351273.185584:0:11642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789351273.185592:0:11642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789351273.185964:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:3.0:1789351273.185973:0:11642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789351273.441535:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789351274.234569:0:12882:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789351274.252317:0:12882:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789351274.252393:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351274.252408:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6c70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351274.252416:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6c70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351274.252441:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6c70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351274.252468:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789351274.252474:0:12882:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789351274.252496:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789351274.252500:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789351274.252506:0:12882:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789351274.252530:0:12882:0:(import.c:65:import_set_state_nolock()) ffff8d2cf95f3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789351274.252673:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876270626440832:0@lo:39:umount.0 00000100:00100000:1.0:1789351274.252745:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351274.252792:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626440832 00000100:00100000:2.0:1789351274.252800:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626440832 00000100:00100000:2.0:1789351274.252849:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00010000:00010000:3.0:1789351274.252855:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789351274.252858:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876270626440832:12345-0@lo:39:umount.0 00010000:00010000:3.0:1789351274.252862:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6c70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.252881:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f79600 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:3.0:1789351274.252886:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6c70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789351274.252893:0:5822:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df69c9 00000100:00080000:2.0:1789351274.252900:0:5822:0:(import.c:65:import_set_state_nolock()) ffff8d2cc308c800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789351274.252901:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6ea017771df6c70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789351274.252908:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6ea017771df6c70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351274.252914:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789351274.252917:0:5810:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789351274.252919:0:5810:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789351274.252945:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df6c70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.252951:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789351274.252969:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df6c70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351274.252970:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3285:x1876270626440832:12345-0@lo:39:umount.0 Request processed in 113us (225us total) trans 0 rc 0/0 00010000:00010000:3.0:1789351274.252976:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79600/0xa6ea017771df6c69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df6c70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351274.252978:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000020:00000080:2.0:1789351274.252987:0:5822:0:(genops.c:906:class_export_put()) final put ffff8d2cf7732800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1789351274.252988:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351274.252989:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351274.252991:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351274.253001:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626440960:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1789351274.253004:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cf7732800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1789351274.253036:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1789351274.253045:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2cc308c800 for lustre-MDT0000 00000100:00100000:3.0:1789351274.253071:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626440960 00000100:00080000:2.0:1789351274.253073:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2cf95f3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789351274.253074:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626440960 00000100:00100000:2.0:1789351274.253083:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876270626440832:0@lo:39:umount.0 00000100:00080000:2.0:1789351274.253102:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789351274.253105:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789351274.253105:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789351274.253108:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1789351274.253111:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc6583450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3289:x1876270626440960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789351274.253120:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351274.253137:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ceecd9e00/0xa6ea017771df6c70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6ea017771df6c69 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.253148:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351274.253175:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc6583450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7166352-9951-4386-a0b0-6dc1f552d00a+18:3289:x1876270626440960:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351274.253182:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789351274.253318:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351274.253353:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f7166352-9951-4386-a0b0-6dc1f552d00a:3289:1876270626440960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789351274.255109:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.255126:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6c7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.255148:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6c7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.255155:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6c7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.255182:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789351274.255189:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6bb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.255196:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6bb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.255202:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6bb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.255208:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6bb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.255225:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789351274.255232:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6e5a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.255331:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789351274.255338:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6c7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.255346:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8a00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:3.0:1789351274.255350:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6c7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.255385:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6ea017771df6c7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789351274.255392:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6ea017771df6c7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351274.255398:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789351274.255400:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1789351274.255427:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df6c7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.255434:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789351274.255512:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df6c7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.255530:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df6c77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df6c7e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.255543:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351274.255546:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6bb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.255552:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031a00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:3.0:1789351274.255555:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6bb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.255562:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6ea017771df6bb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789351274.255568:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6ea017771df6bb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351274.255573:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789351274.255575:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789351274.255577:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789351274.255592:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df6bb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.255598:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789351274.255604:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df6bb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.255610:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cc0031a00/0xa6ea017771df6bac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df6bb3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.255632:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351274.255634:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351274.255635:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351274.255698:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626441216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789351274.255777:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351274.255828:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789351274.255834:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626441088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789351274.255856:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351274.255901:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626441216 00000100:00100000:1.0:1789351274.255907:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626441216 00000100:00100000:1.0:1789351274.255950:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626441088 00000100:00100000:1.0:1789351274.255953:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626441088 00000100:00100000:1.0:1789351274.255975:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789351274.255983:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+19:3287:x1876270626441216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351274.255994:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351274.256007:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d02045000/0xa6ea017771df6bb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6ea017771df6bac expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351274.256020:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351274.256054:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+18:3287:x1876270626441216:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351274.256062:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789351274.256077:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789351274.256084:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+17:3287:x1876270626441088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351274.256105:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351274.256113:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cf0f78e00/0xa6ea017771df6c7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6ea017771df6c77 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351274.256121:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351274.256142:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+16:3287:x1876270626441088:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351274.256146:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789351274.256160:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351274.256176:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626441088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789351274.256181:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f7166352-9951-4386-a0b0-6dc1f552d00a:3287:1876270626441216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789351274.256269:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6e5a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.256273:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6e5a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.256285:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6e5a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.256292:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789351274.256296:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78600/0xa6ea017771df6928 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df692f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.256300:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78600/0xa6ea017771df6928 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df692f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.256304:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78600/0xa6ea017771df6928 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df692f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.256307:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78600/0xa6ea017771df6928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df692f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.256316:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789351274.256318:0:12882:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789351274.256320:0:12882:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789351274.256344:0:12882:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789351274.256347:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789351274.256349:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789351274.256353:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789351274.256369:0:12882:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8d2cffbd5000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789351274.256373:0:12882:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8d2bc13e0800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789351274.256376:0:12882:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8d2cd8390000) has exports, disconnecting them 00000020:00080000:2.0:1789351274.256379:0:12882:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d2cffbd5000), last request at 1789351272 00000020:00000080:2.0:1789351274.256383:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6b2e 00000100:00080000:2.0:1789351274.256399:0:12882:0:(import.c:65:import_set_state_nolock()) ffff8d2cffbd2000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789351274.256431:0:12882:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2cffbd5000): rc 0 00000020:00000080:2.0:1789351274.256433:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cffbd5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789351274.256439:0:12882:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d2bc13e0800), last request at 1789351272 00000020:00000080:2.0:1789351274.256442:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6a55 00000100:00080000:2.0:1789351274.256445:0:12882:0:(import.c:65:import_set_state_nolock()) ffff8d2bc13e2000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1789351274.256451:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cffbd5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789351274.256483:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2cffbd2000 for lustre-MDT0000 00000020:00080000:2.0:1789351274.256498:0:12882:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2bc13e0800): rc 0 00000020:00000080:2.0:1789351274.256500:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2bc13e0800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1789351274.256512:0:12882:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb7648195fae0 00000020:00000080:2.0:1789351274.256524:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2bc13e0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789351274.256555:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2bc13e2000 for lustre-MDT0000 00000100:00080000:2.0:1789351274.256577:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789351274.256580:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1789351274.256589:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789351274.256639:0:12882:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789351274.256648:0:12882:0:(import.c:65:import_set_state_nolock()) ffff8d2cffa6e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789351274.256657:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789351274.256658:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 3 00000100:00100000:2.0:1789351274.256664:0:12882:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8d2cf7259f80 x1876270626439808/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789351284 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789351274.256670:0:12882:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2cf7259f80, transno 4294967324 00000004:00080000:2.0:1789351274.256677:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789351274.256730:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626441344:0@lo:9:umount.0 00000100:00100000:2.0:1789351274.256754:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351274.256778:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626441344 00000100:00100000:2.0:1789351274.256780:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626441344 00000100:00100000:2.0:1789351274.256809:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789351274.256813:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876270626441344:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789351274.256828:0:6660:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6ab0 00000100:00080000:2.0:1789351274.256832:0:6660:0:(import.c:65:import_set_state_nolock()) ffff8d2bc1917800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789351274.256848:0:6660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1789351274.257141:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3285:x1876270626441344:12345-0@lo:9:umount.0 Request processed in 325us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351274.257148:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1789351274.257168:0:12882:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789351274.257178:0:12882:0:(import.c:65:import_set_state_nolock()) ffff8d2d00814000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789351274.257208:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8d2cd8390000) has no exports 00010000:00010000:3.0:1789351274.257469:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789351274.257476:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6e5a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.257485:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1600 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:3.0:1789351274.257488:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6e5a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.257497:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6ea017771df6e5a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789351274.257505:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6ea017771df6e5a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351274.257510:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789351274.257512:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789351274.257514:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:1.0:1789351274.257521:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789351274.257528:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351274.257533:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df6e5a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351274.257533:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78600/0xa6ea017771df6928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df692f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.257540:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789351274.257540:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f78600 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:1.0:1789351274.257543:0:8417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78600/0xa6ea017771df6928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df692f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351274.257550:0:8417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78600/0xa6ea017771df6928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6ea017771df692f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.257555:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df6e5a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789351274.257556:0:8417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78600/0xa6ea017771df6928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6ea017771df692f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351274.257562:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1600/0xa6ea017771df6e53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df6e5a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351274.257562:0:8417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789351274.257564:0:8417:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789351274.257572:0:8417:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789351274.257579:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351274.257581:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351274.257583:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351274.257584:0:8417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78600/0xa6ea017771df6928 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df692f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351274.257589:0:8417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789351274.257593:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf9d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626441600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351274.257596:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78600/0xa6ea017771df6928 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df692f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351274.257602:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f78600/0xa6ea017771df6928 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df692f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351274.257613:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351274.257614:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351274.257616:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351274.257621:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351274.257623:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351274.257635:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626441600 00000100:00100000:1.0:1789351274.257639:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626441600 00000100:00100000:3.0:1789351274.257645:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789351274.257650:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626441728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789351274.257666:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789351274.257670:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351274.257672:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+16:3288:x1876270626441600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351274.257681:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351274.257691:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df6e5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6ea017771df6e53 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351274.257702:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351274.257776:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+15:3288:x1876270626441600:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351274.257782:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789351274.257793:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626441728 00000100:00100000:1.0:1789351274.257797:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626441728 00000100:00100000:1.0:1789351274.257824:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789351274.257831:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+15:3288:x1876270626441728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351274.257844:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351274.257852:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cd5930400/0xa6ea017771df692f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6ea017771df6928 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351274.257863:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351274.257895:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7166352-9951-4386-a0b0-6dc1f552d00a+14:3288:x1876270626441728:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351274.257901:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1789351274.257938:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2cffa6e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789351274.257947:0:3285:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789351274.257949:0:3285:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789351274.257991:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626441344:0@lo:9:umount.0 00000100:00100000:0.0:1789351274.258008:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626441472:0@lo:9:umount.0 00000100:00100000:0.0:1789351274.258033:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351274.258110:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626441472 00000100:00100000:2.0:1789351274.258114:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626441472 00000100:00100000:2.0:1789351274.258175:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789351274.258181:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876270626441472:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789351274.258197:0:6661:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6bdd 00000100:00080000:2.0:1789351274.258203:0:6661:0:(import.c:65:import_set_state_nolock()) ffff8d2bc1e6c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789351274.258226:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789351274.258411:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf9d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626441600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789351274.258428:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f7166352-9951-4386-a0b0-6dc1f552d00a:3288:1876270626441728:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789351274.258444:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789351274.258533:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3285:x1876270626441472:12345-0@lo:9:umount.0 Request processed in 351us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351274.258540:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789351274.258679:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000100:00080000:3.0:1789351274.258684:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2d00814000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789351274.258700:0:3285:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789351274.258703:0:3285:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789351274.258706:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626441472:0@lo:9:umount.0 00000100:00080000:0.0:1789351274.258799:0:5818:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:2.0:1789351274.265838:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8d2cd8390000) has no exports 00000020:00000080:2.0:1789351274.308972:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6983 00000020:00000080:2.0:1789351274.308992:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cd83a9800/lustre-QMT0000_UUID 00000020:01000000:2.0:1789351274.309066:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789351274.309173:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cd83a9800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789351274.309197:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789351274.309209:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789351274.309213:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8d2cfa7fb380) has no exports 00000020:00000080:0.0:1789351274.309657:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df697c 00000020:00000080:0.0:1789351274.309663:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cefc02800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789351274.309722:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cefc02800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789351274.309880:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789351274.309888:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789351274.309891:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cd1633000/lustre-QMT0000_UUID 00000020:00000080:0.0:1789351274.309894:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cd1633000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789351274.309899:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1789351274.310194:0:12882:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d2cf9f947e0 - data ffff8d2cde188510/ffff8d2cff9f7000 00000020:01000000:0.0:1789351274.310618:0:12882:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d2cd028a360 - data ffff8d2ce5757948/ffff8d2cefc14000 00000001:00000004:0.0:1789351274.325552:0:12882:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1789351274.382738:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789351274.382745:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789351274.382773:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789351274.382775:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789351274.383861:0:6690:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789351274.383875:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1789351274.383887:0:6690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789351274.384746:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789351274.384751:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1789351274.384770:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789351274.384772:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789351274.385639:0:8178:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789351274.385644:0:8178:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 2 00000040:00080000:1.0:1789351274.385654:0:8178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789351274.454711:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df694b 00000020:00000080:1.0:1789351274.454728:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cf7736800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789351274.454895:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cf7736800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789351274.455453:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6960 00000020:00000080:1.0:1789351274.455459:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cf7730000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789351274.455482:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789351274.455490:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789351274.455498:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789351274.455502:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8d2cd8394d40) has no exports 00000020:00000080:2.0:1789351274.455528:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cf7730000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1789351274.455658:0:12882:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789351274.455667:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6bd6 00000020:00000080:1.0:1789351274.455671:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cf74f8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789351274.455687:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789351274.455691:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789351274.455698:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789351274.455700:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8d2cc6f1b380) has no exports 00000020:00000080:1.0:1789351274.455707:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6bcf 00000020:00000080:1.0:1789351274.455710:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2d00810800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789351274.455716:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cf74f8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789351274.455761:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2d00810800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789351274.456109:0:12882:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789351274.456113:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789351274.456118:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1789351274.456123:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789351274.456125:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789351274.456165:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789351274.456168:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2d00814000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789351274.456174:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789351274.456179:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2bc139a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789351274.456182:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2bc139a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789351274.456187:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789351274.456257:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6a9b 00000020:00000080:1.0:1789351274.456261:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cffa6f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789351274.456271:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789351274.456275:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789351274.456279:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789351274.456282:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8d2ce9de99c0) has no exports 00000020:00000080:1.0:1789351274.456286:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6a94 00000020:00000080:2.0:1789351274.456291:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cffa6f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789351274.456291:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cffa68000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789351274.456445:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cffa68000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789351274.456747:0:12882:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789351274.456750:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789351274.456753:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1789351274.456757:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789351274.456758:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789351274.456789:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789351274.456793:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2cffa6e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789351274.456795:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789351274.456804:0:38:0:(genops.c:906:class_export_put()) final put ffff8d2cc5aaa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789351274.456807:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cc5aaa800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789351274.456819:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789351274.456825:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789351274.456829:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789351274.456832:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cf95f0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789351274.456835:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cf95f0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789351274.456840:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789351274.457457:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6967 00000020:00000080:1.0:1789351274.457471:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cf7731000/lustre-MDD0000_UUID 00000020:01000000:1.0:1789351274.457488:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789351274.457492:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789351274.457496:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789351274.457499:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8d2cd8393380) has no exports 00000020:00000080:1.0:1789351274.457518:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789351274.457522:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789351274.457526:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df696e 00000020:00000080:1.0:1789351274.457529:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cf7733000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789351274.457537:0:12882:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2cc5fed000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789351274.457541:0:12882:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2cc5fed000 3 00000020:01000004:1.0:1789351274.457544:0:12882:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2cc5fed000 from lustre-MDT0000 00000020:00000080:0.0:1789351274.457557:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cf7731000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789351274.457563:0:38:0:(genops.c:906:class_export_put()) final put ffff8d2cf7731800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789351274.457564:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789351274.457565:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cf7731800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789351274.457569:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789351274.457572:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789351274.457574:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cf7736000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789351274.457578:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cf7736000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789351274.457587:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789351274.457623:0:12882:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789351274.457628:0:12882:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789351274.457631:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789351274.457634:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789351274.457637:0:12882:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789351274.457644:0:12882:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8d2cd1684800 f7166352-9951-4386-a0b0-6dc1f552d00a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789351274.457650:0:12882:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8d2cc5f83380) has exports, disconnecting them 00000020:00080000:1.0:1789351274.457655:0:12882:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d2cd1684800), last request at 1789351142 00000020:00000080:1.0:1789351274.457669:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df690c 00000020:00010000:1.0:1789351274.457674:0:12882:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d2cd1684800: total 2 00000100:00080000:1.0:1789351274.457678:0:12882:0:(import.c:65:import_set_state_nolock()) ffff8d2cd1687800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789351274.457699:0:12882:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2cd1684800): rc 0 00000020:00080000:1.0:1789351274.457703:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8d2cc5f83380) has no exports 00000020:00000080:0.0:1789351274.457761:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cf7733000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1789351274.457807:0:8417:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d2cd1684800: total 0 00000100:00100000:1.0:1789351274.457824:0:5817:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d2cc5f7c000:5817] 2 exiting: rc = 0 00010000:00010000:2.0:1789351274.457842:0:8417:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8d2cd1684800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1789351274.457884:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cd5930c00/0xa6ea017771df6a08 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6ea017771df6a01 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.457905:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ceecd9c00/0xa6ea017771df6c54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6ea017771df6c4d expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.457917:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d00bc1400/0xa6ea017771df6e4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6ea017771df6e45 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.457926:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d021c4200/0xa6ea017771df6e3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6ea017771df6e37 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.457939:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cd5930800/0xa6ea017771df6c1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6ea017771df6c15 expref: 5 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.457963:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d021c5800/0xa6ea017771df6c9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6ea017771df6c93 expref: 4 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.457975:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cf0f78a00/0xa6ea017771df6c2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6ea017771df6c23 expref: 3 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351274.457990:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cd5930e00/0xa6ea017771df6c46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6ea017771df6c3f expref: 2 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351274.458003:0:5816:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d2cc5f7ce00:5816] 1 exiting: rc = 0 00010000:00010000:2.0:1789351274.458005:0:8417:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8d2cd1684800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1789351274.458025:0:8417:0:(genops.c:906:class_export_put()) final put ffff8d2cd1684800/f7166352-9951-4386-a0b0-6dc1f552d00a 00010000:00010000:2.0:1789351274.458036:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351274.458039:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351274.458041:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789351274.458077:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cd1684800/f7166352-9951-4386-a0b0-6dc1f552d00a for MGS 00000100:00100000:1.0:1789351274.458404:0:5814:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d2cc5a65400:5814] 0 exiting: rc = 1 00000100:00100000:1.0:1789351274.459782:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459791:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459797:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459803:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459810:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459816:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459822:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459827:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459833:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459839:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459844:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459850:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459857:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459874:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459881:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459886:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459893:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459899:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459904:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459910:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459916:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459922:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459928:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459933:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459939:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459944:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459950:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459954:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459959:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459963:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459968:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459974:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459981:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459987:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.459993:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460013:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460019:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460027:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460033:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460039:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460045:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460051:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460057:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460062:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460068:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460073:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460080:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460087:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460092:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460097:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460115:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460121:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460127:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460132:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460137:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460142:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460148:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460153:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460159:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460165:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460169:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460176:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460182:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.460188:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789351274.460590:0:12882:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789351274.460594:0:12882:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1789351274.462098:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2cd1687800 for MGS 00000020:01000000:0.0:1789351274.464433:0:12882:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d2cf9f94f00 - data ffff8d2cffe8eca8/ffff8d2bc251e800 00000020:01000000:0.0:1789351274.464730:0:12882:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d2cc6111660 - data ffff8d2ce5750d80/ffff8d2cc4781000 00000020:00000080:0.0:1789351274.465387:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df68f0 00000020:00000080:0.0:1789351274.465397:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cd8427800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789351274.465416:0:12882:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2cc5fed000 from MGS, refs=2 00000020:01000004:0.0:1789351274.465420:0:12882:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2cc5fed000 2 00000020:01000004:0.0:1789351274.465423:0:12882:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2cc5fed000 from MGS 00000020:00000080:0.0:1789351274.465446:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789351274.465454:0:12882:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789351274.465457:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cc5feb800/MGS 00000020:00000080:0.0:1789351274.465459:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cc5feb800/MGS for MGS 00000020:01000000:0.0:1789351274.465465:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789351274.465527:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789351274.465531:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789351274.465536:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789351274.465544:0:12882:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d2cf95f4000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789351274.465564:0:12882:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8d2ce9deb380) has exports, disconnecting them 00000020:00080000:0.0:1789351274.465569:0:12882:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d2cf95f4000), last request at 1789351142 00000020:00000080:0.0:1789351274.465575:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df69bb 00000020:00000080:2.0:1789351274.465579:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cd8427800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:0.0:1789351274.465588:0:12882:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2cf95f4000): rc 0 00000020:00000080:0.0:1789351274.465594:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cf95f4000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789351274.465608:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cf95f4000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789351274.467471:0:12882:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789351274.467479:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789351274.467483:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789351274.467490:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789351274.467612:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789351274.467619:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789351274.467625:0:12882:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2cc5fed000 1 00000020:00000080:2.0:1789351274.467630:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df68e2 00000020:00000080:2.0:1789351274.467636:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cc5fe8800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789351274.467640:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789351274.467645:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789351274.467648:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789351274.467651:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8d2cc5f80000) has no exports 00000020:00000080:2.0:1789351274.467692:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2cf95f3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789351274.467697:0:38:0:(genops.c:906:class_export_put()) final put ffff8d2cf7732000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789351274.467699:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cf7732000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789351274.467705:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789351274.467753:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cc5fe8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1789351274.467847:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789351274.488403:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789351274.488422:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789351274.488428:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cc5fec000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789351274.488433:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cc5fec000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789351274.488445:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789351274.488635:0:12882:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d2cc5fea800 00000020:01000000:2.0:1789351274.488661:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789351274.488666:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789351274.488671:0:12882:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789351274.488675:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8d2cc5f819c0) has no exports 00000100:00100000:2.0:1789351274.488773:0:5824:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8d2cd162d800:5824] 2 exiting: rc = 0 00000100:00100000:2.0:1789351274.488915:0:5822:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8d2cd162da00:5822] 0 exiting: rc = 1 00000100:00100000:0.0:1789351274.490400:0:9467:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8d2cf9f91c00:9467] 3 exiting: rc = 0 00000100:00100000:1.0:1789351274.491082:0:10562:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8d2cc463c400:10562] 4 exiting: rc = 0 00000100:00100000:0.0:1789351274.491441:0:5823:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8d2cd162d000:5823] 1 exiting: rc = 0 00000100:00100000:2.0:1789351274.491815:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491823:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491828:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491833:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491838:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491843:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491859:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491874:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491881:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491886:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491891:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491897:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491902:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491907:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491912:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491931:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491936:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491941:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491948:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491953:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491958:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491963:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491969:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491974:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491979:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491983:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491989:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491993:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.491999:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492003:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492009:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492013:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492018:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492023:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492028:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492033:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492037:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492042:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492047:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492051:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492056:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492061:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492066:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492070:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492075:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492080:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492085:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492090:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492094:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492099:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492107:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492112:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492117:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492122:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492127:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492132:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492138:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492143:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492148:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492153:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492158:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492163:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492168:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.492173:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.495240:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d2cc6fa0e00:5826] 1 exiting: rc = 0 00000100:00100000:1.0:1789351274.495282:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d2cd162c200:5825] 0 exiting: rc = 1 00000100:00100000:0.0:1789351274.495636:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495647:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495654:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495661:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495667:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495673:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495680:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495687:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495695:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495701:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495708:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495715:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495722:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495728:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495733:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495739:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495744:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495750:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495755:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495761:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495779:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495786:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495792:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495797:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495803:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495809:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495827:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495832:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495838:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495844:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495850:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495856:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495876:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495883:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495889:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495894:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495899:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495905:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495911:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495916:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495922:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495927:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495933:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495938:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495943:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495948:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495954:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495959:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495966:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495972:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495978:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495983:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495988:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495993:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.495998:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.496004:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.496010:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.496015:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.496022:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.496027:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.496034:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.496047:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.496051:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.496057:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496501:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8d2cd82ac600:5827] 0 exiting: rc = 1 00000100:00100000:1.0:1789351274.496565:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8d2cc6fa0200:5828] 1 exiting: rc = 0 00000100:00100000:2.0:1789351274.496620:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496641:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496651:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496657:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496665:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496671:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496677:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496684:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496690:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496696:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496703:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496709:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496715:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496721:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496741:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496749:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496755:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496761:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496780:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496793:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496800:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496806:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496812:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496818:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496823:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496829:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496848:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496855:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496877:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496884:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496891:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496896:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496901:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496908:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496915:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496921:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496926:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496932:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496954:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496961:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496967:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496974:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496981:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496988:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.496994:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497000:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497007:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497014:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497027:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497036:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497068:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497076:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497083:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497092:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497105:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497113:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497120:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497128:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497136:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497144:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497153:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497160:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497167:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.497181:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.504553:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d2cd82adc00:5829] 0 exiting: rc = 1 00000100:00100000:1.0:1789351274.504562:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d2cd1691000:5830] 1 exiting: rc = 0 00000100:00100000:0.0:1789351274.504640:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504646:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504651:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504655:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504660:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504664:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504669:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504674:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504679:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504684:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504689:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504693:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504697:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504701:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504706:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504709:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504714:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504718:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504722:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504726:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504731:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504734:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504739:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504743:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504746:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504750:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504755:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504758:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504763:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504767:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504771:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504775:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504788:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504793:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504798:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504807:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504814:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504824:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504831:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504835:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504841:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504846:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504850:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504853:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504856:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504858:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504870:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504877:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504884:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504896:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504902:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504908:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504917:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504922:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504927:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504932:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504938:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504945:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504952:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504958:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504965:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504971:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504978:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.504984:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351274.505345:0:5831:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d2cd1690600:5831] 0 exiting: rc = 1 00000100:00100000:2.0:1789351274.505496:0:5832:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d2cd1690200:5832] 1 exiting: rc = 0 00000100:00100000:0.0:1789351274.505538:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505546:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505554:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505569:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505576:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505583:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505590:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505597:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505602:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505608:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505614:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505619:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505624:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505628:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505633:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505638:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505643:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505647:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505654:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505663:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505671:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505680:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505685:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505688:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505694:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505698:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505704:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505709:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505713:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505719:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505724:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505729:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505734:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505741:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505749:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505755:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505762:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505769:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505781:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505788:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505795:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505801:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505808:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505816:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505822:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505828:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505835:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505841:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505847:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505853:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505860:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505879:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505886:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505892:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505898:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505905:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505911:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505918:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505928:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505937:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505945:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505951:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505954:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.505961:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.506302:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d2cd1690c00:5834] 1 exiting: rc = 0 00000100:00100000:1.0:1789351274.506391:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d2cd1690800:5833] 0 exiting: rc = 1 00000100:00100000:0.0:1789351274.506414:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506423:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506429:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506433:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506439:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506444:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506447:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506451:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506454:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506465:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506470:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506476:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506481:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506487:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506492:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506498:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506504:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506508:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506512:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506518:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506523:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506527:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506531:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506535:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506540:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506545:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506549:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506555:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506564:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506572:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506581:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506588:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506592:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506599:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506603:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506609:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506619:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506624:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506629:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506634:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506640:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506646:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506653:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506660:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506671:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506676:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506680:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506685:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506690:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506695:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506699:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506703:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506706:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506711:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506715:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506719:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506722:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506726:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506730:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506737:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506744:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506751:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506758:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.506763:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351274.507285:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8d2cd162ea00:5836] 1 exiting: rc = 0 00000100:00100000:1.0:1789351274.507295:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8d2cd162ee00:5835] 0 exiting: rc = 1 00000100:00100000:3.0:1789351274.507512:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8d2cd162f600:5837] 2 exiting: rc = 0 00000100:00100000:0.0:1789351274.507562:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507574:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507609:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507619:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507626:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507634:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507658:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507667:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507676:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507683:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507691:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507699:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507705:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507712:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507720:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507733:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507740:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507753:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507760:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507766:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507775:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507786:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507796:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507802:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507811:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507816:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507823:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507829:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507874:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507882:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507914:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507923:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507931:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507937:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507945:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507952:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507958:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507965:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507972:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507981:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507991:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.507998:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508006:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508014:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508023:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508032:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508040:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508047:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508054:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508064:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508082:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508090:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508099:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508104:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508126:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508134:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508163:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508167:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508171:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508174:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508178:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508181:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508185:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351274.508188:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789351274.511208:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789351274.511221:0:12882:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789351274.511227:0:12882:0:(genops.c:906:class_export_put()) final put ffff8d2cd8424000/MDS_uuid 00000020:00000080:0.0:1789351274.511231:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cd8424000/MDS_uuid for MDS 00000020:01000000:0.0:1789351274.511236:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789351274.511347:0:12882:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789351275.489538:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351276.513456:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789351276.587202:0:13033:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789351276.597016:0:13033:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789351276.597055:0:13033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c46 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351276.597117:0:13033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6c46 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351276.597124:0:13033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6c46 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351276.597129:0:13033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6c46 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351276.597190:0:13033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789351276.597196:0:13033:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789351276.597216:0:13033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789351276.597219:0:13033:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789351276.597231:0:13033:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789351276.597251:0:13033:0:(import.c:65:import_set_state_nolock()) ffff8d2bc13e7800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789351276.597346:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1876270626441856:0@lo:39:umount.0 00000400:00000100:3.0:1789351276.597423:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876270626441856 offset 0 length 224: 4 00010000:00010000:1.0:1789351276.597510:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789351276.597518:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6c46 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351276.597526:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cd5930600 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:1.0:1789351276.597529:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6c46 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351276.597538:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6ea017771df6c46 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789351276.597545:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6ea017771df6c46 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351276.597551:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789351276.597554:0:5810:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789351276.597556:0:5810:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789351276.597578:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df6c46 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351276.597582:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789351276.597621:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626441984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789351276.597659:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789351276.597716:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df6c46 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351276.597724:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cd5930600/0xa6ea017771df6c3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6ea017771df6c46 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351276.597746:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351276.597748:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351276.597750:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789351276.597780:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626441984 00000100:00100000:2.0:1789351276.597787:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626441984 00000100:00100000:2.0:1789351276.597825:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789351276.597843:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3286:x1876270626441984:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789351276.597849:0:5809:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789351276 with bad export cookie 12027427367369533708 00000100:00100000:2.0:1789351276.603314:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3286:x1876270626441984:12345-0@lo:103:ldlm_bl.0 Request processed in 5461us (5645us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789351276.603330:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1789351276.603781:0:3286:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789351276.603788:0:3286:0:(import.c:65:import_set_state_nolock()) ffff8d2cc6ceb000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789351276.603792:0:3286:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789351276.607921:0:3286:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.152@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789351276.607926:0:3286:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789351276.607937:0:3286:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2cffb66680 x1876270626441984/t0(0) o103->MGC192.168.201.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789351292 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789351276.608012:0:3286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789351276.608029:0:3286:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789351276.608030:0:3286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789351276.608033:0:3286:0:(import.c:65:import_set_state_nolock()) ffff8d2cc6ceb000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789351276.608037:0:3286:0:(import.c:510:import_select_connection()) MGC192.168.201.152@tcp: connect to NID 0@lo last attempt 86 00000100:00080000:0.0:1789351276.608043:0:3286:0:(import.c:624:import_select_connection()) MGC192.168.201.152@tcp: import ffff8d2cc6ceb000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789351276.608115:0:3286:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2ceee16d80 x1876270626442112/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789351276.608178:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f7166352-9951-4386-a0b0-6dc1f552d00a:3285:1876270626442112:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1789351276.608227:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876270626442112 offset 0 length 520: 4 00000100:00100000:0.0:1789351276.608292:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f7166352-9951-4386-a0b0-6dc1f552d00a:3286:1876270626441984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789351277.217681:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876270626442240:0@lo:400:kworker.0 00000400:00000100:2.0:1789351277.217730:0:3287:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876270626442240 offset 0 length 224: 4 00000001:00100000:1.0:1789351277.265701:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789351277.265709:0:6689:0:(genops.c:906:class_export_put()) final put ffff8d2bc1914800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789351277.265767:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8237986d-b9e8-417a-ac8f-a078390d268c 00000020:00000080:1.0:1789351277.265770:0:6689:0:(genops.c:906:class_export_put()) final put ffff8d2cc517b000/8237986d-b9e8-417a-ac8f-a078390d268c 00000020:00000080:3.0:1789351277.265808:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2bc1914800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789351277.265915:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2bc1917800 for lustre-OST0000 00000020:00000080:3.0:1789351277.265984:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cc517b000/8237986d-b9e8-417a-ac8f-a078390d268c for lustre-OST0000 00000020:00000080:3.0:1789351277.266002:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2cc517e800 for lustre-OST0000 00010000:00010000:0.0:1789351277.539577:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789351278.297428:0:7616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789351278.297437:0:7616:0:(genops.c:906:class_export_put()) final put ffff8d2bc1e6f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789351278.297508:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2bc1e6f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789351278.297563:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2bc1e6c800 for lustre-OST0001 00010000:00010000:2.0:1789351278.561536:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351279.585593:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351280.609857:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351281.633512:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789351282.339945:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) f7166352-9951-4386-a0b0-6dc1f552d00a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789351282.339956:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) f7166352-9951-4386-a0b0-6dc1f552d00a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789351282.340071:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626442368:0@lo:400:kworker.0 00000400:00000100:3.0:1789351282.340124:0:3288:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876270626442368 offset 0 length 224: 4 00010000:00010000:1.0:1789351282.657583:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351283.681583:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351284.705528:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351285.729553:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351286.753577:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351286.945479:0:3285:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789351276/real 1789351276] req@ffff8d2ceee16d80 x1876270626442112/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789351286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351286.945514:0:3285:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2ceee16d80 x1876270626442112/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789351286 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351286.945526:0:3285:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789351276/real 1789351276] req@ffff8d2cffadaa00 x1876270626441856/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789351286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351286.945538:0:3285:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2cffadaa00 x1876270626441856/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789351286 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789351286.945556:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2cc6ceb000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789351286.945582:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789351286.945587:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f7166352-9951-4386-a0b0-6dc1f552d00a:3285:1876270626442112:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1789351286.945593:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2bc13e7800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789351286.945623:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1876270626441856:0@lo:39:umount.0 00000100:00080000:3.0:1789351286.945704:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) f7166352-9951-4386-a0b0-6dc1f552d00a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789351286.945710:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789351286.945713:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d2cc6ceb000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789351286.945719:0:38:0:(import.c:510:import_select_connection()) MGC192.168.201.152@tcp: connect to NID 0@lo last attempt 221 00000100:00080000:3.0:1789351286.945724:0:38:0:(import.c:589:import_select_connection()) MGC192.168.201.152@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789351286.945730:0:38:0:(import.c:624:import_select_connection()) MGC192.168.201.152@tcp: import ffff8d2cc6ceb000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789351286.945760:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2ceec47800 x1876270626442496/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789351286.945828:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f7166352-9951-4386-a0b0-6dc1f552d00a:3285:1876270626442496:0@lo:250:kworker.0 00000400:00000100:0.0:1789351286.945874:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876270626442496 offset 0 length 520: 4 00000100:00100000:3.0:1789351286.945990:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789351286.946000:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626442624:0@lo:400:kworker.0 00000400:00000100:3.0:1789351286.946025:0:3288:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876270626442624 offset 0 length 224: 4 00000100:00080000:2.0:1789351286.946133:0:13033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789351286.946137:0:13033:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789351286.946142:0:13033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789351286.947055:0:13033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351286.947069:0:13033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6c54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351286.947077:0:13033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6c54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351286.947098:0:13033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6c54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351286.947125:0:13033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789351286.947132:0:13033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6e4c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351286.947139:0:13033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6e4c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351286.947145:0:13033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6e4c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351286.947151:0:13033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6e4c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351286.947173:0:13033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789351286.947177:0:13033:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789351286.947200:0:13033:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789351286.947204:0:13033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789351286.947208:0:13033:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789351286.947213:0:13033:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789351286.947217:0:13033:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8d2cffbd99c0) has no exports 00000020:00080000:2.0:1789351286.947242:0:13033:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8d2cffbd99c0) has no exports 00010000:00010000:1.0:1789351286.947261:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789351286.947270:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6c54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351286.947345:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cd5931400 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:1.0:1789351286.947351:0:8417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6c54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351286.947384:0:8417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6ea017771df6c54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789351286.947392:0:8417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6ea017771df6c54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351286.947398:0:8417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789351286.947408:0:8417:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789351286.947411:0:8417:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789351286.947424:0:8417:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2cc6ceb000 00010000:00010000:1.0:1789351286.947429:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6ea017771df6c54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351286.947436:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931400/0xa6ea017771df6c4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6ea017771df6c54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351286.947452:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789351286.947455:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6e4c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351286.947461:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c5e00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:1.0:1789351286.947464:0:8417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6e4c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351286.947595:0:8417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6ea017771df6e4c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789351286.947602:0:8417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6ea017771df6e4c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351286.947608:0:8417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789351286.947610:0:8417:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789351286.947612:0:8417:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789351286.947619:0:8417:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2cc6ceb000 00010000:00010000:1.0:1789351286.947622:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6ea017771df6e4c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351286.947629:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5e00/0xa6ea017771df6e45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6ea017771df6e4c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351286.947722:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351286.947724:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351286.947726:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351286.948138:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789351286.951623:0:13033:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d2cda2722a0 - data ffff8d2cffe17000/ffff8d2d00bf7c00 00000020:01000000:2.0:1789351286.951833:0:13033:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d2cf9fa4cc0 - data ffff8d2cde3d45e8/ffff8d2bc18ecc00 00100000:10000000:2.0:1789351286.958190:0:13033:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789351286.988278:0:13033:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6a24 00000020:00000080:0.0:1789351286.988352:0:13033:0:(genops.c:906:class_export_put()) final put ffff8d2cffbd3000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789351286.990561:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cffbd3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:0.0:1789351286.990781:0:13033:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2cf76fd000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789351286.990787:0:13033:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2cf76fd000 2 00000020:01000004:0.0:1789351286.990791:0:13033:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2cf76fd000 from lustre-OST0000 00000020:00000080:0.0:1789351286.990831:0:13033:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789351286.990842:0:13033:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789351286.990846:0:13033:0:(genops.c:906:class_export_put()) final put ffff8d2cffbd4000/lustre-OST0000_UUID 00000020:00000080:0.0:1789351286.990849:0:13033:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cffbd4000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789351286.990862:0:13033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789351286.990978:0:13033:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789351286.990983:0:13033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789351286.990987:0:13033:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789351286.990992:0:13033:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789351286.990999:0:13033:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d2bc13e7000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789351286.991005:0:13033:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8d2cfa7f8000) has exports, disconnecting them 00000020:00080000:0.0:1789351286.991010:0:13033:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d2bc13e7000), last request at 1789351152 00000020:00000080:0.0:1789351286.991053:0:13033:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6a4e 00000020:00080000:0.0:1789351286.991073:0:13033:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2bc13e7000): rc 0 00000020:00000080:0.0:1789351286.991079:0:13033:0:(genops.c:906:class_export_put()) final put ffff8d2bc13e7000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789351286.991122:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2bc13e7000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789351286.999818:0:13033:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789351286.999840:0:13033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789351286.999845:0:13033:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789351286.999854:0:13033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789351287.000002:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2bc13e7800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789351287.000034:0:13033:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789351287.000042:0:13033:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789351287.000048:0:13033:0:(genops.c:906:class_export_put()) final put ffff8d2d00811800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789351287.000052:0:13033:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2d00811800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789351287.000063:0:13033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1789351287.000129:0:13033:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2cf76fd000 1 00000020:00000080:1.0:1789351287.000137:0:13033:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df69de 00000020:00000080:1.0:1789351287.000144:0:13033:0:(genops.c:906:class_export_put()) final put ffff8d2cefc06000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789351287.000150:0:13033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789351287.000155:0:13033:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789351287.000160:0:13033:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789351287.000164:0:13033:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8d2cfa7f99c0) has no exports 00000020:00000080:3.0:1789351287.000462:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cefc06000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789351287.018267:0:13033:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789351287.018350:0:13033:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789351287.018446:0:13033:0:(genops.c:906:class_export_put()) final put ffff8d2cf76fc000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789351287.018452:0:13033:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cf76fc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789351287.018463:0:13033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789351287.018613:0:13033:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d2cf76fe800 00000020:02000400:0.0:1789351287.018742:0:13033:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789351287.779722:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789351288.529851:0:13188:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789351288.536629:0:13188:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789351288.536745:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c1c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351288.536761:0:13188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6c1c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351288.536784:0:13188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6c1c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351288.536790:0:13188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6c1c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351288.536842:0:13188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789351288.536849:0:13188:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789351288.536883:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789351288.536894:0:13188:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2ceee15c00 x1876270626442240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351293 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351288.536914:0:13188:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2cffb66300 x1876270626442368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351298 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351288.536939:0:13188:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2ceec44000 x1876270626442624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351302 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789351288.536947:0:13188:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789351288.536954:0:13188:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789351288.536987:0:13188:0:(import.c:65:import_set_state_nolock()) ffff8d2bc1e68800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789351288.537018:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876270626442240:0@lo:400:kworker.0 00010000:00010000:1.0:1789351288.537031:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789351288.537038:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6c1c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351288.537047:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c5c00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:1.0:1789351288.537050:0:8417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6c1c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351288.537059:0:8417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6ea017771df6c1c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789351288.537073:0:8417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6ea017771df6c1c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351288.537079:0:8417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789351288.537081:0:8417:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789351288.537083:0:8417:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789351288.537097:0:8417:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2cc6ceb000 00010000:00010000:1.0:1789351288.537100:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6ea017771df6c1c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351288.537105:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2d021c5c00/0xa6ea017771df6c15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6ea017771df6c1c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351288.537115:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351288.537116:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351288.537118:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351288.537129:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626442624:0@lo:400:kworker.0 00000100:00100000:0.0:1789351288.537142:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626442368:0@lo:400:kworker.0 00000100:00100000:1.0:1789351288.537145:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1876270626442752:0@lo:39:umount.0 00000400:00000100:1.0:1789351288.537205:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876270626442752 offset 0 length 224: 4 00010000:00010000:3.0:1789351288.801559:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351289.825909:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351290.849709:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351291.873646:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789351292.066177:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f7166352-9951-4386-a0b0-6dc1f552d00a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789351292.066192:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f7166352-9951-4386-a0b0-6dc1f552d00a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789351292.897602:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351293.923410:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351294.948115:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351295.969626:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351296.994565:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789351297.186199:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f7166352-9951-4386-a0b0-6dc1f552d00a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789351297.186214:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f7166352-9951-4386-a0b0-6dc1f552d00a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789351298.017689:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351298.721843:0:3285:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789351288/real 1789351288] req@ffff8d2ceec45180 x1876270626442752/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789351298 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351298.721881:0:3285:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2ceec45180 x1876270626442752/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789351298 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789351298.721905:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2bc1e68800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789351298.721924:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1876270626442752:0@lo:39:umount.0 00000100:00080000:3.0:1789351298.722390:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789351298.722397:0:13188:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789351298.722424:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789351298.725093:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6c2a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351298.725118:0:13188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6c2a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351298.725127:0:13188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6c2a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351298.725136:0:13188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6c2a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351298.725172:0:13188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789351298.725181:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df6e3e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351298.725188:0:13188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df6e3e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351298.725195:0:13188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6e3e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351298.725201:0:13188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6ea017771df6e3e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351298.725224:0:13188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789351298.725238:0:13188:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:1.0:1789351298.725244:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789351298.725260:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6c2a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351298.725273:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c4c00 already unused, calling callback (ffffffffc1cf8c20) 00000020:01000004:3.0:1789351298.725279:0:13188:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789351298.725286:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789351298.725294:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 10000000:00010000:1.0:1789351298.725301:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6c2a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789351298.725310:0:13188:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:1.0:1789351298.725313:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6ea017771df6c2a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789351298.725317:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8d2cc5f84d40) has no exports 10000000:00010000:1.0:1789351298.725327:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6ea017771df6c2a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351298.725334:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789351298.725338:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1789351298.725341:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00000020:00080000:3.0:1789351298.725355:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8d2cc5f84d40) has no exports 00010000:00010000:1.0:1789351298.725391:0:5811:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2cc6ceb000 00010000:00010000:1.0:1789351298.725397:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6ea017771df6c2a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351298.725405:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2d021c4c00/0xa6ea017771df6c23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6ea017771df6c2a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351298.725425:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789351298.725429:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6e3e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351298.725436:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030c00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:1.0:1789351298.725439:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6ea017771df6e3e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351298.725446:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6ea017771df6e3e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789351298.725453:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6ea017771df6e3e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351298.725471:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789351298.725474:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789351298.725486:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789351298.725493:0:5811:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2cc6ceb000 00010000:00010000:1.0:1789351298.725496:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6ea017771df6e3e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351298.725503:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cc0030c00/0xa6ea017771df6e37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6ea017771df6e3e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351298.725519:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351298.725521:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351298.725523:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351298.725565:0:8417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789351298.727174:0:13188:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d2cf9f94120 - data ffff8d2cffe40000/ffff8d2bc12fe400 00000020:01000000:3.0:1789351298.727444:0:13188:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d2cda272660 - data ffff8d2cffe17870/ffff8d2d00bf4400 00100000:10000000:3.0:1789351298.744560:0:13188:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789351298.771864:0:13188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6afd 00000020:00000080:0.0:1789351298.771877:0:13188:0:(genops.c:906:class_export_put()) final put ffff8d2cffa1e800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789351298.771934:0:13188:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2cc5aa8000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789351298.771939:0:13188:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2cc5aa8000 2 00000020:01000004:0.0:1789351298.771943:0:13188:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2cc5aa8000 from lustre-OST0001 00000020:00000080:0.0:1789351298.771977:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789351298.771992:0:13188:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789351298.771995:0:13188:0:(genops.c:906:class_export_put()) final put ffff8d2cffa1b000/lustre-OST0001_UUID 00000020:00000080:0.0:1789351298.771999:0:13188:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cffa1b000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789351298.772008:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789351298.772197:0:13188:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f7166352-9951-4386-a0b0-6dc1f552d00a->MGS 00010000:00010000:0.0:1789351298.772217:0:13188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79e00/0xa6ea017771df6a01 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6ea017771df6a08 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789351298.772249:0:13188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79e00/0xa6ea017771df6a01 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6ea017771df6a08 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351298.772256:0:13188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789351298.772259:0:13188:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789351298.772263:0:13188:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789351298.772280:0:13188:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2cc6ceb000 00010000:00010000:0.0:1789351298.772284:0:13188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cf0f79e00/0xa6ea017771df6a01 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6ea017771df6a08 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351298.772302:0:13188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6ea017771df6c9a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789351298.772310:0:13188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6ea017771df6c9a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351298.772315:0:13188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789351298.772317:0:13188:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789351298.772319:0:13188:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789351298.772327:0:13188:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2cc6ceb000 00010000:00010000:0.0:1789351298.772330:0:13188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2cd5931600/0xa6ea017771df6c93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6ea017771df6c9a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789351298.772348:0:13188:0:(import.c:65:import_set_state_nolock()) ffff8d2cc6ceb000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789351298.772352:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789351298.772355:0:13188:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789351298.772597:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789351298.772604:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789351298.772616:0:13188:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2ceec47800 x1876270626442496/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789351301 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:2.0:1789351298.773045:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cffa1e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1789351298.773086:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789351298.773090:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:1.0:1789351298.773142:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f7166352-9951-4386-a0b0-6dc1f552d00a:3285:1876270626442496:0@lo:250:kworker.0 10000000:01000000:0.0:1789351298.773206:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789351298.773216:0:13188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df68fe 00000020:00000080:0.0:1789351298.773224:0:13188:0:(genops.c:906:class_export_put()) final put ffff8d2cd8421800/f7166352-9951-4386-a0b0-6dc1f552d00a 00000020:01000000:0.0:1789351298.773240:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.152@tcp (flags='') 00000020:00000080:0.0:1789351298.773245:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789351298.773252:0:13188:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.152@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789351298.773257:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8d2cd83919c0) has no exports 00000020:00000080:2.0:1789351298.773294:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cd8421800/f7166352-9951-4386-a0b0-6dc1f552d00a for MGC192.168.201.152@tcp 10000000:01000000:1.0:1789351298.773329:0:5820:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789351298.773518:0:13188:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.152@tcp: client import never connected 00000100:00080000:0.0:1789351298.773521:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789351298.773524:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789351298.773526:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789351298.773528:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789351298.773584:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789351298.773589:0:13188:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.152@tcp (uuid f7166352-9951-4386-a0b0-6dc1f552d00a) 00000020:01000000:0.0:1789351298.773595:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789351298.773598:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789351298.773602:0:13188:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789351298.773607:0:13188:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d2bc1e6b800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789351298.773613:0:13188:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff8d2bc1e60000) has exports, disconnecting them 00000020:00080000:0.0:1789351298.773618:0:13188:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d2bc1e6b800), last request at 1789351162 00000020:00000080:0.0:1789351298.773622:0:13188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6b27 00000020:00080000:0.0:1789351298.773634:0:13188:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2bc1e6b800): rc 0 00000020:00000080:0.0:1789351298.773638:0:13188:0:(genops.c:906:class_export_put()) final put ffff8d2bc1e6b800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789351298.773784:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2cc6ceb000 for MGC192.168.201.152@tcp 00000020:00000080:2.0:1789351298.773791:0:38:0:(genops.c:906:class_export_put()) final put ffff8d2cc6cec800/f7166352-9951-4386-a0b0-6dc1f552d00a 00000020:00000080:2.0:1789351298.773793:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cc6cec800/f7166352-9951-4386-a0b0-6dc1f552d00a for MGC192.168.201.152@tcp 00000020:01000000:2.0:1789351298.773799:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.152@tcp (f7166352-9951-4386-a0b0-6dc1f552d00a) 00000020:00000080:2.0:1789351298.774073:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2bc1e6b800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1789351298.774925:0:13188:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789351298.774932:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789351298.774936:0:13188:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789351298.774942:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789351298.775032:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d2bc1e68800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1789351298.775108:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789351298.775487:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789351298.775600:0:8417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789351298.775762:0:8416:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_003: service thread [ffff8d2cf9d4ee00:8416] 3 exiting: rc = 0 00000100:00100000:2.0:1789351298.775898:0:7614:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8d2cffa72000:7614] 2 exiting: rc = 0 00000100:00100000:2.0:1789351298.775974:0:5805:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d2cd157f800:5805] 0 exiting: rc = 1 00000100:00100000:3.0:1789351298.776157:0:5806:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d2cd157e600:5806] 1 exiting: rc = 0 00000100:00100000:1.0:1789351298.776343:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776657:0:5808:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d2cd157e800:5808] 1 exiting: rc = 0 00000100:00100000:1.0:1789351298.776723:0:5807:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d2cd157f400:5807] 0 exiting: rc = 1 00000100:00100000:1.0:1789351298.776768:0:5809:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d2cd157ec00:5809] 2 exiting: rc = 0 00000100:00100000:1.0:1789351298.776819:0:6676:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d2cef3c3800:6676] 3 exiting: rc = 0 00000100:00100000:1.0:1789351298.776865:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776871:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776878:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776898:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776904:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776909:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776915:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776923:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776929:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776935:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776942:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776949:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776955:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776961:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776967:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776973:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776979:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776984:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776989:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.776995:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777001:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777007:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777013:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777019:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777024:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777029:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777035:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777041:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777046:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777052:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777058:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777063:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777069:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777074:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777080:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777085:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777090:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777096:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777108:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777114:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777119:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777125:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777131:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777137:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777143:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777148:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777154:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777159:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777164:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777170:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777175:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777180:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777185:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777191:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777196:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777203:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777208:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777214:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777220:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777225:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777231:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777236:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777242:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.777248:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789351298.777928:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789351298.777939:0:13188:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789351298.777947:0:13188:0:(genops.c:906:class_export_put()) final put ffff8d2cffa18000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789351298.777952:0:13188:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cffa18000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789351298.777957:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1789351298.778003:0:13188:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2cc5aa8000 1 00000020:00000080:1.0:1789351298.778009:0:13188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa6ea017771df6acc 00000020:00000080:1.0:1789351298.778017:0:13188:0:(genops.c:906:class_export_put()) final put ffff8d2cffa69800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789351298.778044:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789351298.778049:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789351298.778054:0:13188:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789351298.778059:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff8d2cffbdcd40) has no exports 00000020:00000080:2.0:1789351298.779336:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cffa69800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789351298.792254:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789351298.792275:0:13188:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789351298.792281:0:13188:0:(genops.c:906:class_export_put()) final put ffff8d2cc5aac000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789351298.792287:0:13188:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cc5aac000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789351298.792295:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789351298.792561:0:13188:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d2cc5aa9000 00000020:01000000:1.0:1789351298.792587:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789351298.792591:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789351298.792597:0:13188:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789351298.792602:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8d2cfa7fcd40) has no exports 00000020:00000080:1.0:1789351298.792639:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789351298.792645:0:13188:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789351298.792648:0:13188:0:(genops.c:906:class_export_put()) final put ffff8d2cefc06800/OSS_uuid 00000020:00000080:1.0:1789351298.792650:0:13188:0:(genops.c:865:class_export_destroy()) destroying export ffff8d2cefc06800/OSS_uuid for OSS 00000020:01000000:1.0:1789351298.792654:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1789351298.792913:0:11341:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8d2cf0fda000:11341] 3 exiting: rc = 0 00000100:00100000:1.0:1789351298.795060:0:6663:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8d2cefd10200:6663] 2 exiting: rc = 0 00000100:00100000:1.0:1789351298.795162:0:6661:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8d2cc6ea8800:6661] 1 exiting: rc = 0 00000100:00100000:1.0:1789351298.795209:0:11977:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8d2cc511b000:11977] 4 exiting: rc = 0 00000100:00100000:1.0:1789351298.795269:0:6660:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8d2cc6ea9a00:6660] 0 exiting: rc = 1 00000100:00080000:0.0:1789351298.796299:0:5818:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789351298.796652:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796664:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796670:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796675:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796681:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796687:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796692:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796697:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796702:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796706:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796799:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796804:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796809:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796815:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796820:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796825:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796830:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796835:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796840:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796845:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796851:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796856:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796861:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796867:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796873:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796878:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796884:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796889:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796894:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796899:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796908:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796913:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796918:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796923:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796927:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796932:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796939:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796944:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796949:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796955:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796959:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796963:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796968:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796972:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796977:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796988:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796992:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.796997:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.797002:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.797007:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.797011:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.797016:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.797021:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.797026:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.797031:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.797036:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.797041:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.797045:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.797049:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.797053:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.797058:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.797063:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.797067:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.797071:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.798267:0:6665:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d2cefd11400:6665] 1 exiting: rc = 0 00000100:00100000:1.0:1789351298.801029:0:6664:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d2cc65c1800:6664] 0 exiting: rc = 1 00000100:00100000:0.0:1789351298.801232:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801240:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801246:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801265:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801270:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801276:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801282:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801287:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801292:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801298:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801303:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801308:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801312:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801317:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801322:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801326:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801330:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801335:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801339:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801344:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801349:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801353:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801380:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801385:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801390:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801394:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801399:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801404:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801409:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801414:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801419:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801423:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801427:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801431:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801436:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801455:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801460:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801465:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801473:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801489:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801494:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801499:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801504:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801510:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801515:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801521:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801526:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801530:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801535:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801539:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801544:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801549:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801553:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801558:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801563:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801568:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801573:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801578:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801583:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801587:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801592:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801596:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801600:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.801605:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.803384:0:6667:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d2ce9e9f800:6667] 1 exiting: rc = 0 00000100:00100000:0.0:1789351298.803551:0:6668:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d2ce9e9fe00:6668] 2 exiting: rc = 0 00000100:00100000:2.0:1789351298.803962:0:6666:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d2cda206e00:6666] 0 exiting: rc = 1 00000100:00100000:1.0:1789351298.804045:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804053:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804059:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804065:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804073:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804079:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804085:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804091:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804097:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804104:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804110:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804117:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804123:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804129:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804147:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804153:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804159:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804165:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804170:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804176:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804182:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804192:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804198:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804205:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804211:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804216:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804224:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804229:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804247:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804253:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804259:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804266:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804271:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804277:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804283:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804289:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804295:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804300:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804305:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804311:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804316:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804322:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804327:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804333:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804338:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804343:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804349:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804354:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804382:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804392:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804398:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804404:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804421:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804427:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804434:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804440:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804445:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804451:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804457:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804462:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804468:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804473:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804487:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789351298.804493:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351298.809787:0:6670:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d2cda207400:6670] 1 exiting: rc = 0 00000100:00100000:3.0:1789351298.809852:0:6669:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d2ce9e9ea00:6669] 0 exiting: rc = 1 00000100:00100000:0.0:1789351298.809926:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.809936:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.809942:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.809948:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.809954:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.809961:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.809966:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.809970:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.809986:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.809991:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.809995:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.809999:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810002:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810006:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810010:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810013:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810016:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810019:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810022:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810026:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810029:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810032:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810036:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810040:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810044:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810047:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810051:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810055:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810058:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810061:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810065:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810069:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810072:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810075:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810078:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810085:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810089:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810093:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810096:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810101:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810104:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810107:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810111:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810120:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810125:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810129:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810133:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810137:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810142:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810146:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810149:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810152:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810156:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810160:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810164:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810168:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810171:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810175:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810179:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810183:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810186:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810189:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810192:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.810196:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789351298.810817:0:6671:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d2cd82b5400:6671] 0 exiting: rc = 1 00000100:00100000:3.0:1789351298.811052:0:6672:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d2cd82b5600:6672] 1 exiting: rc = 0 00000100:00100000:0.0:1789351298.811138:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811144:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811150:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811156:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811161:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811166:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811172:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811177:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811182:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811186:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811191:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811195:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811209:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811214:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811225:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811230:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811235:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811240:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811245:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811250:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811254:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811260:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811264:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811270:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811283:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811290:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811295:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811299:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811303:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811307:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811311:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811315:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811320:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811324:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811330:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811335:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811347:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811352:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811413:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811420:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811424:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811429:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811433:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811438:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811442:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811446:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811451:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811455:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811470:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811489:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811494:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811499:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811504:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811508:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811513:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811518:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811522:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811527:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811531:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811536:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811550:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811556:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811560:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789351298.811565:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789351298.822081:0:13188:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789351309.256498:0:13803:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789351314.618299:0:14265:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789351314.618305:0:14265:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789351314.618656:0:14265:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8d2cffaea000 00000020:01000004:0.0:1789351314.618673:0:14265:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789351314.618682:0:14265:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789351314.618696:0:14265:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d2cc6f199c0) 00000020:00000080:0.0:1789351314.618710:0:14265:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789351314.638088:0:14265:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789351314.640139:0:14265:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789351314.640663:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1789351314.640853:0:14265:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789351314.640922:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1789351314.641016:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1789351314.641106:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1789351314.641193:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1789351314.641308:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1789351314.641709:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1789351314.642797:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 201: rc = 0 00100000:10000000:2.0:1789351314.642893:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 201: rc = 0 00100000:10000000:2.0:1789351314.643281:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 592: rc = 0 00100000:10000000:2.0:1789351314.643770:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1789351314.644018:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1789351314.644321:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1789351314.644680:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 592: rc = 0 00100000:10000000:2.0:1789351314.644938:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 592: rc = 0 00100000:10000000:2.0:1789351314.645197:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 592: rc = 0 00100000:10000000:2.0:1789351314.645654:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 592: rc = 0 00100000:10000000:2.0:1789351314.645906:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1789351314.646148:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1789351314.646597:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1789351314.646892:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 592: rc = 0 00100000:10000000:2.0:1789351314.647316:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 216: rc = 0 00100000:10000000:2.0:1789351314.647745:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 216: rc = 0 00100000:10000000:2.0:1789351314.647998:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 216: rc = 0 00100000:10000000:2.0:1789351314.648260:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 216: rc = 0 00100000:10000000:2.0:1789351314.648673:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 216: rc = 0 00100000:10000000:2.0:1789351314.648952:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 216: rc = 0 00100000:10000000:2.0:1789351314.649271:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 216: rc = 0 00100000:10000000:2.0:1789351314.649680:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 216: rc = 0 00100000:10000000:2.0:1789351314.649913:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 216: rc = 0 00100000:10000000:2.0:1789351314.650158:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 216: rc = 0 00100000:10000000:2.0:1789351314.650584:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 216: rc = 0 00100000:10000000:2.0:1789351314.650821:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 216: rc = 0 00100000:10000000:2.0:1789351314.651071:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 216: rc = 0 00100000:10000000:2.0:1789351314.651349:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 216: rc = 0 00100000:10000000:2.0:1789351314.651759:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 216: rc = 0 00100000:10000000:2.0:1789351314.652017:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 216: rc = 0 00100000:10000000:2.0:1789351314.652290:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 216: rc = 0 00100000:10000000:2.0:1789351314.652637:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 216: rc = 0 00100000:10000000:2.0:1789351314.652873:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 216: rc = 0 00100000:10000000:2.0:1789351314.653117:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 216: rc = 0 00100000:10000000:2.0:1789351314.653707:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 216: rc = 0 00100000:10000000:2.0:1789351314.654004:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 216: rc = 0 00100000:10000000:2.0:1789351314.654272:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 216: rc = 0 00100000:10000000:2.0:1789351314.654636:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 216: rc = 0 00100000:10000000:2.0:1789351314.655166:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 216: rc = 0 00100000:10000000:2.0:1789351314.655812:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 216: rc = 0 00100000:10000000:2.0:1789351314.656065:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 216: rc = 0 00100000:10000000:2.0:1789351314.656328:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 216: rc = 0 00100000:10000000:2.0:1789351314.656725:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 216: rc = 0 00100000:10000000:2.0:1789351314.657841:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 216: rc = 0 00100000:10000000:2.0:1789351314.658093:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 216: rc = 0 00100000:10000000:2.0:1789351314.658390:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 216: rc = 0 00100000:10000000:2.0:1789351314.659065:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 205: rc = 0 00100000:10000000:2.0:1789351314.659715:0:14265:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789351314.659886:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00100000:10000000:2.0:1789351314.660126:0:14265:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789351314.660195:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:2.0:1789351314.660581:0:14265:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789351314.660656:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:2.0:1789351314.661011:0:14265:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789351314.661073:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 202: rc = 0 00100000:10000000:2.0:1789351314.661263:0:14265:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789351314.661333:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 202: rc = 0 00100000:10000000:2.0:1789351314.661628:0:14265:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789351314.661695:0:14265:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 202: rc = 0 00000020:00000080:2.0:1789351314.662065:0:14265:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789351314.662072:0:14265:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789351314.662083:0:14265:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6ea017771df7bff 00000020:01000004:2.0:1789351314.662091:0:14265:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789351314.662096:0:14265:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789351314.662101:0:14265:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2cffaea000 from MGS 00000020:01000004:2.0:1789351314.662105:0:14265:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789351314.662114:0:14265:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d2bc1e63380) 00000020:00000080:2.0:1789351314.662124:0:14265:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789351314.662175:0:14265:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2cffaea000 from MGS, refs=2 00080000:01000000:2.0:1789351314.662179:0:14265:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789351314.662185:0:14265:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6ea017771df7c0d 00000100:00100000:2.0:1789351314.662294:0:14265:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789351314.663471:0:14265:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789351314.663479:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789351314.664261:0:14265:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789351314.664271:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789351314.665336:0:14265:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789351314.665648:0:14265:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789351314.665654:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789351314.666120:0:14265:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789351314.666128:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789351314.666558:0:14265:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789351314.666565:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789351314.667304:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351314.667307:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351314.667308:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351314.667642:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351314.667645:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351314.667647:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351314.668091:0:14265:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789351314.669686:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789351314.693092:0:14265:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789351314.693110:0:14265:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789351314.693113:0:14265:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789351314.698105:0:14274:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789351314.698312:0:14265:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789351314.698538:0:14265:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789351314.699796:0:14265:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789351314.700172:0:14265:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789351314.700349:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789351314.701262:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789351314.705035:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789351314.705052:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789351314.705622:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789351314.705630:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789351314.707643:0:14265:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789351314.707669:0:14265:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.152@tcp' 00000020:01000004:3.0:1789351314.707671:0:14265:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789351314.707702:0:14265:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.152@tcp (typ=mgc) 00000020:00000080:3.0:1789351314.707719:0:14265:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.152@tcp (ffff8d2ce9decd40) 00000020:00000080:3.0:1789351314.707737:0:14265:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789351314.707816:0:14265:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2ceecd4800@MGC192.168.201.152@tcp: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1789351314.707965:0:14265:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.152@tcp-0 is initialized 00000040:01000000:3.0:1789351314.707971:0:14265:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789351314.708249:0:14279:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789351314.719736:0:14280:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789351314.719874:0:14265:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.152@tcp (uuid cdd22e09-e0b6-4924-ac9c-e7bebc9b89de) 00000020:00000080:0.0:1789351314.719900:0:14265:0:(genops.c:1406:class_connect()) connect: client cdd22e09-e0b6-4924-ac9c-e7bebc9b89de, cookie 0xa6ea017771df7c1b 00000100:00080000:0.0:1789351314.719918:0:14265:0:(import.c:510:import_select_connection()) MGC192.168.201.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789351314.719924:0:14265:0:(import.c:624:import_select_connection()) MGC192.168.201.152@tcp: import ffff8d2ceecd4800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789351314.719955:0:14265:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2ceee16d80 x1876270626442880/t0(0) o250->MGC192.168.201.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789351314.720008:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3285:1876270626442880:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789351314.720120:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351314.720165:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626442880 00000100:00100000:2.0:1789351314.720175:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626442880 00000100:00080000:0.0:1789351314.720186:0:14265:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cdd22e09-e0b6-4924-ac9c-e7bebc9b89de->MGS 00000020:01000004:0.0:1789351314.720204:0:14265:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789351314.720208:0:14265:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00100000:2.0:1789351314.720217:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:00000080:0.0:1789351314.720219:0:14265:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d2cc6f1cd40) 00000100:00100000:2.0:1789351314.720242:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3285:x1876270626442880:12345-0@lo:250:mount.lustre.0 00000020:00000080:0.0:1789351314.720245:0:14265:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00010000:00080000:2.0:1789351314.720268:0:14275:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from cdd22e09-e0b6-4924-ac9c-e7bebc9b89de@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:2.0:1789351314.720301:0:14275:0:(genops.c:1406:class_connect()) connect: client cdd22e09-e0b6-4924-ac9c-e7bebc9b89de, cookie 0xa6ea017771df7c29 00000100:00080000:2.0:1789351314.720451:0:14275:0:(import.c:65:import_set_state_nolock()) ffff8d2cc5b8e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789351314.720888:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+5:3285:x1876270626442880:12345-0@lo:250:mount.lustre.0 Request processed in 646us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351314.720897:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789351314.722720:0:3285:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789351314.722732:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.152@tcp: connect to target with instance 0 00000100:00080000:1.0:1789351314.722740:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789351314.722745:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789351314.722750:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2ceecd4800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789351314.722753:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789351314.722764:0:3285:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789351314.722770:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3285:1876270626442880:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789351314.732047:0:14265:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789351314.732319:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789351314.732326:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789351314.733257:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789351314.733270:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789351314.733765:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789351314.733773:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789351314.734883:0:14265:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789351314.735083:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789351314.735089:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789351314.735565:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789351314.735573:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789351314.776287:0:14265:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789351314.776717:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789351314.776725:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789351314.778532:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789351314.778543:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789351314.779238:0:14265:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789351314.779423:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789351314.779428:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789351314.785048:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789351314.785065:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789351314.788883:0:14265:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789351314.789048:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789351314.789054:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789351314.791469:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789351314.791482:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789351314.793528:0:14265:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789351314.793698:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789351314.793704:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789351314.796082:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789351314.796094:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789351314.809705:0:14265:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789351314.810068:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789351314.810075:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789351314.812479:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789351314.812496:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789351314.813434:0:14265:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789351314.813445:0:14265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789351314.815097:0:14265:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789351314.815119:0:14265:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789351314.815125:0:14265:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789351314.815264:0:14265:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789351314.815298:0:14265:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.152@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789351314.815303:0:14265:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789351314.815304:0:14265:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789351314.815306:0:14265:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789351314.815307:0:14265:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789351314.815308:0:14265:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789351314.815309:0:14265:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789351314.815310:0:14265:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789351314.815312:0:14265:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789351314.815313:0:14265:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789351314.815314:0:14265:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789351314.815317:0:14265:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789351314.815319:0:14265:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789351314.815320:0:14265:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789351314.815321:0:14265:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789351314.815322:0:14265:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789351314.815323:0:14265:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789351314.815324:0:14265:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789351314.815330:0:14265:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789351314.815331:0:14265:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789351314.815332:0:14265:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789351314.815333:0:14265:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789351314.815476:0:14265:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789351314.815496:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626443008:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789351314.815625:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351314.815711:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2c646c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789351314.815793:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626443008 00000100:00100000:0.0:1789351314.815800:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626443008 00000100:00100000:0.0:1789351314.815998:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789351314.816009:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+5:14265:x1876270626443008:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789351314.816051:0:14278:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789351314.816054:0:14278:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789351314.816056:0:14278:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789351314.816336:0:14299:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789351314.816955:0:14278:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1789351314.818094:0:14300:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789351314.818101:0:14300:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789351314.818104:0:14300:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789351314.818135:0:14300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789351314.818675:0:14278:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789351314.818686:0:14278:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789351314.827742:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+5:14265:x1876270626443008:12345-0@lo:253:mount.lustre.0 Request processed in 11726us (12107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351314.827763:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789351314.827914:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626443008:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789351314.827932:0:14265:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789351314.827935:0:14265:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789351314.827937:0:14265:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789351314.827938:0:14265:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789351314.827939:0:14265:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789351314.827940:0:14265:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789351314.827942:0:14265:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789351314.827943:0:14265:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789351314.827945:0:14265:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789351314.827946:0:14265:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789351314.827961:0:14265:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789351314.827983:0:14265:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2cffaea000 from lustre-MDT0000 10000000:01000000:3.0:1789351314.828009:0:14265:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789351314.828012:0:14265:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789351314.828016:0:14265:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d2ce9decd40 10000000:01000000:3.0:1789351314.828022:0:14265:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789351314.828028:0:14265:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2ce9decd40 from 1 10000000:01000000:3.0:1789351314.828030:0:14265:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789351314.828061:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104600/0xa6ea017771df7c30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.828069:0:14265:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104600/0xa6ea017771df7c30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.828076:0:14265:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104600/0xa6ea017771df7c30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351314.828091:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626443136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789351314.828120:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351314.828150:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3031600 going to sleep for 11 seconds 00000100:00100000:2.0:1789351314.828262:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626443136 00000100:00100000:2.0:1789351314.828269:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626443136 00000100:00100000:2.0:1789351314.828318:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789351314.828327:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+5:14265:x1876270626443136:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789351314.828340:0:14277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351314.828354:0:14277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d00bc1000/0xa6ea017771df7c37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7c30 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351314.828412:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d00bc1000/0xa6ea017771df7c37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7c30 expref: 6 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351314.828422:0:14277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d00bc1000/0xa6ea017771df7c37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7c30 expref: 6 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351314.828431:0:14277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1000, rc 0) 00000100:00100000:2.0:1789351314.828579:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+6:14265:x1876270626443136:12345-0@lo:101:mount.lustre.0 Request processed in 253us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351314.828585:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789351314.829190:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626443136:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789351314.829208:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104600/0xa6ea017771df7c30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7c37 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.829231:0:14265:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104600/0xa6ea017771df7c30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7c37 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351314.829291:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626443264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789351314.829326:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351314.829459:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3031600 going to sleep for 11 seconds 00000100:00100000:1.0:1789351314.829609:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626443264 00000100:00100000:1.0:1789351314.829616:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626443264 00000100:00100000:1.0:1789351314.829702:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789351314.829713:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+6:14265:x1876270626443264:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789351314.829956:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+6:14265:x1876270626443264:12345-0@lo:501:mount.lustre.0 Request processed in 245us (628us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789351314.829964:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789351314.830030:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626443264:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789351314.830058:0:14265:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789351314.830084:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104600/0xa6ea017771df7c30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7c37 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.830093:0:14265:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104600/0xa6ea017771df7c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7c37 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351314.830101:0:14265:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2cffaea000 10000000:01000000:3.0:1789351314.830106:0:14265:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789351314.830110:0:14265:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d2cffaea000 10000000:01000000:3.0:1789351314.830113:0:14265:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789351314.830128:0:14265:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8d2cffaea000 from 1 10000000:01000000:3.0:1789351314.830131:0:14265:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789351314.830153:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104800/0xa6ea017771df7c3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.830162:0:14265:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104800/0xa6ea017771df7c3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.830170:0:14265:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104800/0xa6ea017771df7c3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351314.830184:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626443392:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789351314.830210:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351314.830407:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3031600 going to sleep for 11 seconds 00000100:00100000:0.0:1789351314.830461:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626443392 00000100:00100000:0.0:1789351314.830465:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626443392 00000100:00100000:0.0:1789351314.830488:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789351314.830495:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+6:14265:x1876270626443392:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789351314.830573:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351314.830588:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecd9a00/0xa6ea017771df7c45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7c3e expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.830607:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecd9a00/0xa6ea017771df7c45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7c3e expref: 7 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.830625:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecd9a00/0xa6ea017771df7c45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7c3e expref: 7 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.830633:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9a00, rc 0) 00000100:00100000:0.0:1789351314.830721:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+7:14265:x1876270626443392:12345-0@lo:101:mount.lustre.0 Request processed in 226us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351314.830727:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789351314.830786:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626443392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789351314.830797:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104800/0xa6ea017771df7c3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7c45 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.830819:0:14265:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104800/0xa6ea017771df7c3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7c45 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351314.830924:0:14265:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789351314.830981:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104800/0xa6ea017771df7c3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7c45 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.830989:0:14265:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104800/0xa6ea017771df7c3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7c45 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351314.830996:0:14265:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789351314.831000:0:14265:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789351314.831005:0:14265:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d2cffaea000 10000000:01000000:3.0:1789351314.831008:0:14265:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789351314.831011:0:14265:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789351314.831014:0:14265:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789351314.831030:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc3105a00/0xa6ea017771df7c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.831037:0:14265:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cc3105a00/0xa6ea017771df7c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.831045:0:14265:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cc3105a00/0xa6ea017771df7c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351314.831060:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626443520:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789351314.831088:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351314.831112:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3031600 going to sleep for 11 seconds 00000100:00100000:1.0:1789351314.831245:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626443520 00000100:00100000:1.0:1789351314.831250:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626443520 00000100:00100000:1.0:1789351314.831282:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789351314.831290:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+7:14265:x1876270626443520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789351314.831297:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351314.831307:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecc4a00/0xa6ea017771df7c53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7c4c expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351314.831332:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecc4a00/0xa6ea017771df7c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7c4c expref: 8 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351314.831340:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecc4a00/0xa6ea017771df7c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7c4c expref: 8 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351314.831347:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4a00, rc 0) 00000100:00100000:1.0:1789351314.831396:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+8:14265:x1876270626443520:12345-0@lo:101:mount.lustre.0 Request processed in 108us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351314.831402:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789351314.831475:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626443520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789351314.831485:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cc3105a00/0xa6ea017771df7c4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7c53 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.831492:0:14265:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cc3105a00/0xa6ea017771df7c4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7c53 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351314.831543:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626443648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789351314.831567:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351314.831594:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc3031600 going to sleep for 11 seconds 00000100:00100000:2.0:1789351314.831606:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626443648 00000100:00100000:2.0:1789351314.831614:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626443648 00000100:00100000:2.0:1789351314.831654:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789351314.831662:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+8:14265:x1876270626443648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789351314.832015:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+9:14265:x1876270626443648:12345-0@lo:501:mount.lustre.0 Request processed in 353us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351314.832024:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789351314.832052:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626443648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789351314.832090:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee15500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626443776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789351314.832203:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351314.832272:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0c0f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789351314.832312:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626443776 00000100:00100000:1.0:1789351314.832316:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626443776 00000100:00100000:1.0:1789351314.832348:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789351314.832371:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+9:14265:x1876270626443776:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789351314.832810:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+9:14265:x1876270626443776:12345-0@lo:503:mount.lustre.0 Request processed in 454us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351314.832818:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789351314.832929:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee15500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626443776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789351314.836747:0:14301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14301:1876270626443904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789351314.836843:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351314.836892:0:14301:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cffc58d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789351314.836981:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626443904 00000100:00100000:3.0:1789351314.836994:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626443904 00000100:00100000:3.0:1789351314.837618:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789351314.837631:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+9:14301:x1876270626443904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789351314.838094:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+9:14301:x1876270626443904:12345-0@lo:502:llog_process_th.0 Request processed in 465us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351314.838103:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789351314.841747:0:14301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14301:1876270626443904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789351314.841819:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789351314.841835:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351314.841838:0:14301:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789351314.841843:0:14301:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789351314.841846:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789351314.841863:0:14301:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d2bc1e619c0) 00000020:00000080:2.0:1789351314.841882:0:14301:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789351314.841888:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789351314.841962:0:14301:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789351314.841968:0:14301:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6ea017771df7c61 00000020:00000080:2.0:1789351314.842186:0:14301:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789351314.842190:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789351314.842194:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351314.842195:0:14301:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789351314.842198:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789351314.842201:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789351314.842203:0:14301:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789351314.842206:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789351314.842212:0:14301:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d2bc1e64d40) 00000020:00000080:2.0:1789351314.842235:0:14301:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789351314.842241:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789351314.842243:0:14301:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789351314.842256:0:14301:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789351314.842263:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789351314.842310:0:14301:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2cffaea000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789351314.842323:0:14301:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d2bc1e60000) 00000020:00000080:2.0:1789351314.842331:0:14301:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789351314.842404:0:14301:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789351314.842410:0:14301:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6ea017771df7c76 00000020:00000080:3.0:1789351314.843814:0:14301:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789351314.843825:0:14301:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789351314.843834:0:14301:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa6ea017771df7c7d 00080000:01000000:3.0:1789351314.843841:0:14301:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789351314.843846:0:14301:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6ea017771df7c84 00010000:00010000:3.0:1789351314.888845:0:14301:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789351314.889278:0:14301:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1789351314.889542:0:14301:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789351314.890049:0:14301:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d2ce9de8000) 00000020:00000080:3.0:1789351314.890066:0:14301:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789351314.890120:0:14301:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789351314.890134:0:14301:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6ea017771df7c92 00000020:00000080:1.0:1789351314.890589:0:14301:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789351314.893161:0:14301:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa6ea017771df7c99 00000020:00000080:1.0:1789351314.895950:0:14301:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789351314.895965:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789351314.895973:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351314.895976:0:14301:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789351314.895984:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789351314.895987:0:14301:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1789351314.895989:0:14301:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789351314.895990:0:14301:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789351314.895992:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789351314.896004:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351314.896005:0:14301:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789351314.896009:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789351314.896015:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351314.896016:0:14301:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789351314.896020:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789351314.896064:0:14301:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789351314.896079:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789351314.896082:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351314.896083:0:14301:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789351314.896086:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789351314.896089:0:14301:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789351314.896092:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351314.896093:0:14301:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789351314.896095:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789351314.896100:0:14301:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:1.0:1789351314.897811:0:14301:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789351314.897816:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789351314.897830:0:14301:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d2cffbdcd40) 00000020:00000080:1.0:1789351314.897851:0:14301:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789351314.897857:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789351314.897940:0:14301:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789351314.897945:0:14301:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789351314.897953:0:14301:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6ea017771df7ca7 00010000:00080000:1.0:1789351314.897979:0:14301:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2ceecd6000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:1.0:1789351314.898154:0:14301:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789351314.899097:0:14301:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789351314.899149:0:14301:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789351314.900427:0:14301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789351314.900533:0:14301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789351314.900603:0:14301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789351314.901658:0:14305:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789351314.901672:0:14305:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789351314.902076:0:14301:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789351314.902086:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789351314.902112:0:14301:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789351314.902178:0:14301:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6ea017771df7cae 00000100:00080000:0.0:1789351314.902189:0:14301:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789351314.902195:0:14301:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d2ceecd6000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789351314.902243:0:14301:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2ceee15500 x1876270626444032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789351314.902305:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626444032:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789351314.902355:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876270626444032 offset 0 length 520: 4 00000100:00080000:0.0:1789351314.902438:0:14301:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789351314.902484:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789351314.902489:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789351314.902491:0:14301:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789351314.902494:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789351314.902502:0:14301:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1789351314.902503:0:14301:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789351314.902505:0:14301:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789351314.902507:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789351314.902510:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789351314.902512:0:14301:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789351314.902514:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789351314.902519:0:14301:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789351314.902522:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789351314.902524:0:14301:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789351314.902527:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789351314.902530:0:14301:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.152@tcp to nid 0x20000c0a8c998 (192.168.201.152@tcp) 00000020:01000000:0.0:1789351314.902551:0:14301:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789351314.902554:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789351314.902566:0:14301:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d2cc6f18000) 00000020:00000080:0.0:1789351314.902578:0:14301:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789351314.902584:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789351314.902644:0:14301:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789351314.902650:0:14301:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789351314.902657:0:14301:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6ea017771df7cbc 00010000:00080000:0.0:1789351314.902692:0:14301:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2cc308b000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:0.0:1789351314.902840:0:14301:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789351314.902971:0:14301:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789351314.902988:0:14301:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789351314.903175:0:14301:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 0, last_idx 1 00000040:00080000:0.0:1789351314.903480:0:14301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789351314.903541:0:14301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789351314.903606:0:14301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789351314.904079:0:14307:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:0.0:1789351314.904083:0:14307:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789351314.904942:0:14301:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789351314.904950:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789351314.904972:0:14301:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789351314.904985:0:14301:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6ea017771df7cc3 00000100:00080000:3.0:1789351314.904991:0:14301:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789351314.904996:0:14301:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2cc308b000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789351314.905021:0:14301:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2ceec44380 x1876270626444160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789351314.905068:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626444160:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789351314.905125:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876270626444160 offset 0 length 520: 4 00000100:00080000:3.0:1789351314.905205:0:14301:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789351314.905273:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351314.905278:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351314.905280:0:14301:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789351314.905283:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789351314.905287:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351314.905288:0:14301:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789351314.905290:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789351314.905292:0:14301:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789351314.905294:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351314.905295:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351314.905296:0:14301:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789351314.905298:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789351314.905300:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351314.905301:0:14301:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789351314.905303:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789351314.905326:0:14301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec47100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14301:1876270626444288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789351314.905412:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351314.905445:0:14301:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd07886c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351314.905454:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626444288 00000100:00100000:1.0:1789351314.905461:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626444288 00000100:00100000:1.0:1789351314.905527:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789351314.905536:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+9:14301:x1876270626444288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351314.905711:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+9:14301:x1876270626444288:12345-0@lo:502:llog_process_th.0 Request processed in 175us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351314.905718:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789351314.905737:0:14301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec47100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14301:1876270626444288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789351314.905761:0:14301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351314.905770:0:14301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351314.905771:0:14301:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789351314.905775:0:14301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789351314.905930:0:14265:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1789351314.905953:0:14265:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789351314.905983:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc3105a00/0xa6ea017771df7c4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7c53 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.905994:0:14265:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cc3105a00/0xa6ea017771df7c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7c53 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351314.906002:0:14265:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d2cffaea000 from 1 10000000:01000000:0.0:1789351314.906005:0:14265:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789351314.906031:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8e00/0xa6ea017771df7cca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.906039:0:14265:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8e00/0xa6ea017771df7cca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.906046:0:14265:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8e00/0xa6ea017771df7cca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351314.906055:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626444416:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789351314.906076:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351314.906552:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6e29780 going to sleep for 11 seconds 00000100:00100000:1.0:1789351314.906658:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626444416 00000100:00100000:1.0:1789351314.906664:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626444416 00000100:00100000:1.0:1789351314.906694:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789351314.906703:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+9:14265:x1876270626444416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789351314.906712:0:14278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351314.906725:0:14278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecc5a00/0xa6ea017771df7cd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7cca expref: -99 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351314.906741:0:14278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecc5a00/0xa6ea017771df7cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7cca expref: 10 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351314.906749:0:14278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecc5a00/0xa6ea017771df7cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7cca expref: 10 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351314.906755:0:14278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5a00, rc 0) 00000100:00100000:1.0:1789351314.906791:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+10:14265:x1876270626444416:12345-0@lo:101:mount.lustre.0 Request processed in 89us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351314.906797:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789351314.906812:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626444416:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789351314.906824:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8e00/0xa6ea017771df7cca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7cd1 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.906834:0:14265:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8e00/0xa6ea017771df7cca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7cd1 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351314.907272:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626444544:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789351314.907299:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351314.907320:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6e29780 going to sleep for 11 seconds 00000100:00100000:1.0:1789351314.907343:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626444544 00000100:00100000:1.0:1789351314.907348:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626444544 00000100:00100000:1.0:1789351314.907385:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789351314.907392:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+10:14265:x1876270626444544:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789351314.907405:0:14275:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789351314.907411:0:14275:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789351314.907473:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+10:14265:x1876270626444544:12345-0@lo:256:mount.lustre.0 Request processed in 81us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351314.907504:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626444544:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789351314.907649:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 10000000:01000000:0.0:1789351314.908070:0:14265:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789351314.908093:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8e00/0xa6ea017771df7cca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7cd1 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.908102:0:14265:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8e00/0xa6ea017771df7cca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7cd1 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351314.908109:0:14265:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2cffaea000 from 1 10000000:01000000:0.0:1789351314.908112:0:14265:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789351314.908287:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8000/0xa6ea017771df7cd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.908293:0:14265:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8000/0xa6ea017771df7cd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.908299:0:14265:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8000/0xa6ea017771df7cd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351314.908309:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626444672:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789351314.908332:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351314.908412:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6e29780 going to sleep for 11 seconds 00000100:00100000:1.0:1789351314.908633:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626444672 00000100:00100000:1.0:1789351314.908639:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626444672 00000100:00100000:1.0:1789351314.908696:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789351314.908702:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+10:14265:x1876270626444672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789351314.908711:0:14278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351314.908722:0:14278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecc4c00/0xa6ea017771df7cdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7cd8 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351314.908733:0:14278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecc4c00/0xa6ea017771df7cdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7cd8 expref: 11 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351314.908740:0:14278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecc4c00/0xa6ea017771df7cdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7cd8 expref: 11 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351314.908745:0:14278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4c00, rc 0) 00000100:00100000:1.0:1789351314.908806:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+11:14265:x1876270626444672:12345-0@lo:101:mount.lustre.0 Request processed in 104us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351314.908819:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789351314.908872:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626444672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789351314.908881:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8000/0xa6ea017771df7cd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7cdf expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.908887:0:14265:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8000/0xa6ea017771df7cd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7cdf expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351314.908929:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626444800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789351314.908945:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351314.908967:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6e29780 going to sleep for 11 seconds 00000100:00100000:1.0:1789351314.908994:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626444800 00000100:00100000:1.0:1789351314.908997:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626444800 00000100:00100000:1.0:1789351314.909036:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789351314.909041:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+11:14265:x1876270626444800:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789351314.909527:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+11:14265:x1876270626444800:12345-0@lo:501:mount.lustre.0 Request processed in 484us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351314.909534:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789351314.909603:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626444800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789351314.909632:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626444928:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789351314.909670:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351314.912090:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6e29780 going to sleep for 11 seconds 00000100:00100000:3.0:1789351314.912208:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626444928 00000100:00100000:3.0:1789351314.912217:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626444928 00000100:00100000:3.0:1789351314.912275:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789351314.912286:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+11:14265:x1876270626444928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789351314.912541:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+11:14265:x1876270626444928:12345-0@lo:503:mount.lustre.0 Request processed in 257us (2870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351314.912549:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789351314.912679:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626444928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789351314.913769:0:14309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14309:1876270626445056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351314.913823:0:14309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351314.913862:0:14309:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6eb30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789351314.914266:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626445056 00000100:00100000:2.0:1789351314.914273:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626445056 00000100:00100000:2.0:1789351314.914313:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789351314.914322:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+11:14309:x1876270626445056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789351314.914682:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+11:14309:x1876270626445056:12345-0@lo:502:llog_process_th.0 Request processed in 359us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351314.914691:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789351314.914714:0:14309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14309:1876270626445056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789351314.914742:0:14309:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789351314.914752:0:14309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351314.914755:0:14309:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789351314.914762:0:14309:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2cffaea000 00000020:00000080:1.0:1789351314.914765:0:14309:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789351314.914774:0:14309:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789351314.914777:0:14309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351314.914779:0:14309:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789351314.914781:0:14309:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789351314.914783:0:14309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351314.914785:0:14309:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789351314.914788:0:14309:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2cffaea000 00000020:00000080:1.0:1789351314.914790:0:14309:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789351314.914851:0:14309:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789351314.914855:0:14309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351314.914857:0:14309:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789351314.914867:0:14309:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789351314.914870:0:14309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351314.914871:0:14309:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789351314.914875:0:14309:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2cffaea000 00000020:00000080:1.0:1789351314.914877:0:14309:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789351314.914915:0:14309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14309:1876270626445184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351314.914947:0:14309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351314.914980:0:14309:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6eb30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789351314.915262:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626445184 00000100:00100000:2.0:1789351314.915268:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626445184 00000100:00100000:2.0:1789351314.915315:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789351314.915324:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+11:14309:x1876270626445184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789351314.915662:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+11:14309:x1876270626445184:12345-0@lo:502:llog_process_th.0 Request processed in 339us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351314.915669:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789351314.915755:0:14309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14309:1876270626445184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789351314.915775:0:14309:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789351314.915780:0:14309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351314.915781:0:14309:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789351314.915785:0:14309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789351314.918458:0:14265:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789351314.918494:0:14265:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789351314.919673:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8000/0xa6ea017771df7cd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7cdf expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.919689:0:14265:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8000/0xa6ea017771df7cd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7cdf expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351314.919747:0:14265:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789351314.919751:0:14265:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2cffaea000 10000000:01000000:0.0:1789351314.919754:0:14265:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2cffaea000 10000000:01000000:0.0:1789351314.919758:0:14265:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789351314.919764:0:14265:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d2cffaea000 from 1 10000000:01000000:0.0:1789351314.919767:0:14265:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789351314.919801:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8800/0xa6ea017771df7ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.919810:0:14265:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8800/0xa6ea017771df7ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.919828:0:14265:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8800/0xa6ea017771df7ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351314.919853:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626445312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789351314.919916:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351314.919955:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626445312 00000100:00100000:0.0:1789351314.919962:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6e29e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789351314.919964:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626445312 00000100:00100000:2.0:1789351314.920006:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789351314.920017:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+11:14265:x1876270626445312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789351314.920029:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351314.920042:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d00bc1c00/0xa6ea017771df7ced lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7ce6 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351314.920079:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d00bc1c00/0xa6ea017771df7ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7ce6 expref: 12 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351314.920089:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d00bc1c00/0xa6ea017771df7ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7ce6 expref: 12 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351314.920098:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1c00, rc 0) 00000100:00100000:2.0:1789351314.920151:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14265:x1876270626445312:12345-0@lo:101:mount.lustre.0 Request processed in 137us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351314.920158:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789351314.920215:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626445312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789351314.920239:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8800/0xa6ea017771df7ce6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7ced expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.920249:0:14265:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8800/0xa6ea017771df7ce6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7ced expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351314.920300:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626445440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789351314.920329:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351314.920348:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6e29e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789351314.920381:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626445440 00000100:00100000:2.0:1789351314.920386:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626445440 00000100:00100000:2.0:1789351314.920418:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789351314.920426:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14265:x1876270626445440:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789351314.920679:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14265:x1876270626445440:12345-0@lo:501:mount.lustre.0 Request processed in 253us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351314.920687:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789351314.921243:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626445440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789351314.921278:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626445568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789351314.921322:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351314.921354:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6e29e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789351314.923203:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626445568 00000100:00100000:2.0:1789351314.923214:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626445568 00000100:00100000:2.0:1789351314.923277:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789351314.923288:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14265:x1876270626445568:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789351314.923570:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14265:x1876270626445568:12345-0@lo:503:mount.lustre.0 Request processed in 284us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351314.923578:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789351314.924233:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626445568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789351314.934947:0:14313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14313:1876270626445696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789351314.935042:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351314.935084:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626445696 00000100:00100000:0.0:1789351314.935093:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626445696 00000100:00100000:0.0:1789351314.935142:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789351314.935188:0:14313:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6eb3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789351314.935231:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14313:x1876270626445696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789351314.935682:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14313:x1876270626445696:12345-0@lo:502:llog_process_th.0 Request processed in 464us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351314.935692:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789351314.935712:0:14313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14313:1876270626445696:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789351314.935781:0:14313:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789351314.935795:0:14313:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d2cffbd8000) 00000020:00000080:1.0:1789351314.936281:0:14313:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1789351314.936464:0:14313:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2cffaea000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789351314.936468:0:14313:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2cffaea000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789351314.936470:0:14313:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2cffaea000 4 00010000:00080000:1.0:1789351314.936495:0:14313:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2cc6fd4800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.152@tcp at head 00010000:00010000:1.0:1789351314.938211:0:14313:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1789351314.938322:0:14313:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789351314.938346:0:14313:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789351314.938382:0:14313:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa6ea017771df7cfb 00000100:00080000:1.0:1789351314.938394:0:14313:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789351314.938400:0:14313:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d2cc6fd4800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789351314.938467:0:14313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2ceee14a80 x1876270626445824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789351314.938500:0:14313:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789351314.938523:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876270626445824:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789351314.938580:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351314.938663:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626445824 00000100:00100000:0.0:1789351314.938670:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626445824 00000100:00100000:0.0:1789351314.938709:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351314.938718:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1876270626445824:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789351314.938780:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1876270626445824:12345-0@lo:38:llog_process_th.0 Request processed in 61us (198us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789351314.938787:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351314.938860:0:14313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee14700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14313:1876270626445952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789351314.938899:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351314.938919:0:14313:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6e29180 going to sleep for 11 seconds 00000100:00100000:1.0:1789351314.939007:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789351314.939014:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2cc6fd4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789351314.939018:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789351314.939021:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876270626445824:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789351314.939190:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626445952 00000100:00100000:2.0:1789351314.939196:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626445952 00000100:00100000:2.0:1789351314.940898:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789351314.940914:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14313:x1876270626445952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789351314.941268:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14313:x1876270626445952:12345-0@lo:502:llog_process_th.0 Request processed in 360us (2368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351314.941277:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789351314.941342:0:14313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee14700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14313:1876270626445952:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789351314.941402:0:14313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789351314.941860:0:14265:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789351314.941881:0:14265:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789351314.941903:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8800/0xa6ea017771df7ce6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7ced expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.941915:0:14265:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8800/0xa6ea017771df7ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7ced expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789351314.941960:0:14265:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789351314.941962:0:14265:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789351314.941964:0:14265:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789351314.941969:0:14265:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789351314.941970:0:14265:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789351314.941971:0:14265:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789351314.941973:0:14265:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789351314.941974:0:14265:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789351314.941976:0:14265:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789351314.941977:0:14265:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789351314.941980:0:14265:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789351314.941983:0:14265:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789351314.941984:0:14265:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789351314.941985:0:14265:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789351314.941986:0:14265:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789351314.941986:0:14265:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789351314.941987:0:14265:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789351314.941988:0:14265:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789351314.941989:0:14265:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789351314.941990:0:14265:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789351314.941990:0:14265:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789351314.942009:0:14265:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789351314.942024:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626446080:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789351314.942067:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351314.942106:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce6e29780 going to sleep for 11 seconds 00000100:00100000:1.0:1789351314.942139:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626446080 00000100:00100000:1.0:1789351314.942146:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626446080 00000100:00100000:1.0:1789351314.942188:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789351314.942197:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14265:x1876270626446080:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789351314.942232:0:14277:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789351314.942245:0:14277:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789351314.985720:0:14277:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789351314.985746:0:14277:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789351314.985851:0:14299:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789351314.985856:0:14299:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789351314.985879:0:14299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2d00bc1e00/0xa6ea017771df7d02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351314.985899:0:14299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ceecc5a00/0xa6ea017771df7cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7cca expref: 12 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351314.985908:0:14299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2d00bc1e00/0xa6ea017771df7d02 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351314.985951:0:14299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ceecc5a00/0xa6ea017771df7cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df7cca expref: 12 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351314.985964:0:14299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2ceecc5a00/0xa6ea017771df7cd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df7cca expref: 12 pid: 14278 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351314.985984:0:14299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14299:1876270626446208:0@lo:104: 00000100:00100000:2.0:1789351314.986051:0:14299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351314.986143:0:14299:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cffc580c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351314.987394:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626446208 00000100:00100000:1.0:1789351314.987410:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626446208 00000100:00100000:1.0:1789351314.987469:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789351314.987479:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+3:14299:x1876270626446208:12345-0@lo:104: 00010000:00010000:1.0:1789351314.987498:0:14266:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8e00/0xa6ea017771df7cca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df7cd1 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351314.987595:0:14266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789351314.987602:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+3:14299:x1876270626446208:12345-0@lo:104: Request processed in 125us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351314.987606:0:14299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14299:1876270626446208:0@lo:104: 00000100:00100000:1.0:1789351314.987621:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789351314.987632:0:14299:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2d00bc1e00/0xa6ea017771df7d02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.987715:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351314.987722:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8e00/0xa6ea017771df7cca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df7cd1 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.987731:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8e00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:3.0:1789351314.987735:0:14272:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8e00/0xa6ea017771df7cca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df7cd1 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.987743:0:14272:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8e00/0xa6ea017771df7cca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df7cd1 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789351314.987751:0:14272:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8e00/0xa6ea017771df7cca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df7cd1 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351314.987757:0:14272:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789351314.987850:0:14272:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8e00/0xa6ea017771df7cca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7cd1 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.987858:0:14272:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789351314.987882:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8e00/0xa6ea017771df7cca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7cd1 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.987896:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8e00/0xa6ea017771df7cca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7cd1 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351314.987911:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351314.987913:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351314.987914:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351314.987937:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3286:1876270626446336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789351314.987970:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351314.988075:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626446336 00000100:00100000:0.0:1789351314.988081:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626446336 00010000:00010000:0.0:1789351314.988101:0:14268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ceecc5a00/0xa6ea017771df7cd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df7cca expref: 13 pid: 14278 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351314.988492:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351314.988503:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+13:3286:x1876270626446336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789351314.988515:0:14268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351314.988522:0:14268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ceecc5a00/0xa6ea017771df7cd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df7cca expref: 13 pid: 14278 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.988534:0:14268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ceecc5a00/0xa6ea017771df7cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df7cca expref: 13 pid: 14278 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.988560:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ceecc5a00/0xa6ea017771df7cd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df7cca expref: 13 pid: 14278 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.988574:0:14268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2d00bc1e00/0xa6ea017771df7d02 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.988582:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d00bc1e00/0xa6ea017771df7d02 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789351314.988596:0:14268:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002740836s 00010000:00010000:0.0:1789351314.988600:0:14268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2d00bc1e00/0xa6ea017771df7d02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.988607:0:14268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2d00bc1e00/0xa6ea017771df7d02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.988613:0:14268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2d00bc1e00/0xa6ea017771df7d02 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.988619:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2d00bc1e00/0xa6ea017771df7d02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.988625:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1e00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351314.988629:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2d00bc1e00/0xa6ea017771df7d02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.988636:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2d00bc1e00/0xa6ea017771df7d02 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.988659:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2d00bc1e00/0xa6ea017771df7d02 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351314.988675:0:14268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351314.988719:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:3286:x1876270626446336:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351314.988726:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789351314.988738:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3286:1876270626446336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789351314.988786:0:14299:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2d00bc1e00/0xa6ea017771df7d02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351314.988801:0:14299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2d00bc1e00/0xa6ea017771df7d02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351314.988806:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d00bc1e00/0xa6ea017771df7d02 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351314.998489:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+11:14265:x1876270626446080:12345-0@lo:253:mount.lustre.0 Request processed in 56285us (56412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351314.998504:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789351314.998697:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14265:1876270626446080:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789351314.998713:0:14265:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789351314.998716:0:14265:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789351314.998717:0:14265:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789351314.998719:0:14265:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789351314.998720:0:14265:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789351314.998721:0:14265:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789351314.998722:0:14265:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789351314.998723:0:14265:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789351314.998725:0:14265:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789351314.998727:0:14265:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789351314.998728:0:14265:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789351314.998744:0:14265:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789351315.003109:0:14265:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789351315.003273:0:14265:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789351315.004079:0:14265:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789351315.004433:0:14265:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789351315.004814:0:14265:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789351315.004935:0:14265:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789351315.005692:0:14265:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789351315.005843:0:14265:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789351315.006155:0:14265:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789351315.006321:0:14265:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789351315.006802:0:14265:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789351315.006953:0:14265:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1789351315.027653:0:14265:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1789351315.028941:0:14265:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789351315.029182:0:14321:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789351315.029188:0:14321:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1789351315.029319:0:14322:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1789351315.029449:0:14322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789351315.031154:0:14322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789351315.031212:0:14322:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789351315.031227:0:14322:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1789351315.036437:0:14265:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789351315.036531:0:14265:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789351315.036857:0:14265:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789351315.036862:0:14265:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789351315.036934:0:14265:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789351315.037910:0:14265:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789351315.038349:0:14265:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789351315.038428:0:14265:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789351315.038836:0:14265:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1789351315.039668:0:14265:0:(osd_index.c:2105:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1789351315.044470:0:14265:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789351315.068105:0:14265:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789351315.068147:0:14265:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb76481cb3988 00100000:10000000:3.0:1789351315.068155:0:14265:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789351315.068819:0:14265:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789351315.068830:0:14265:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789351315.068840:0:14265:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1789351315.068852:0:14265:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789351315.685353:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789351315.937954:0:14315:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789351315.937964:0:14315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789351315.938554:0:14315:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1789351315.938562:0:14315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:1.0:1789351316.257597:0:14280:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789351316.257604:0:14280:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d2cffaea000 from 6 10000000:01000000:1.0:1789351316.257609:0:14280:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789351316.257658:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4800/0xa6ea017771df7d09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351316.257670:0:14280:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4800/0xa6ea017771df7d09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351316.257681:0:14280:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4800/0xa6ea017771df7d09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351316.257705:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626446464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789351316.257777:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351316.257861:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0788c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789351316.259590:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626446464 00000100:00100000:2.0:1789351316.259603:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626446464 00000100:00100000:3.0:1789351316.259737:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789351316.259749:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+11:14280:x1876270626446464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789351316.259764:0:14278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351316.259784:0:14278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cc3104400/0xa6ea017771df7d10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7d09 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351316.259810:0:14278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cc3104400/0xa6ea017771df7d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7d09 expref: 12 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351316.259821:0:14278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cc3104400/0xa6ea017771df7d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7d09 expref: 12 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351316.259829:0:14278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104400, rc 0) 00000100:00100000:3.0:1789351316.259901:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14280:x1876270626446464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351316.259908:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789351316.260258:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626446464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789351316.260276:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4800/0xa6ea017771df7d09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d10 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351316.260287:0:14280:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4800/0xa6ea017771df7d09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7d10 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351316.260342:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626446592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789351316.260418:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351316.260449:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0788c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789351316.260553:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626446592 00000100:00100000:0.0:1789351316.260559:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626446592 00000100:00100000:0.0:1789351316.260590:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789351316.260599:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14280:x1876270626446592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789351316.260613:0:14277:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789351316.260627:0:14277:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789351316.260631:0:14277:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789351316.260705:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14280:x1876270626446592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351316.260712:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789351316.260826:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626446592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789351316.260865:0:14280:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789351316.260872:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4800/0xa6ea017771df7d09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d10 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351316.260879:0:14280:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4800/0xa6ea017771df7d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d10 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351316.710227:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789351316.961885:0:14315:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789351316.961894:0:14315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789351316.961928:0:14315:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1789351316.961934:0:14315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789351317.736012:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789351318.027809:0:14564:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789351318.753556:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351319.778630:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789351319.990300:0:14715:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa88cf6d0 20000000:00000080:1.0:1789351319.990323:0:14715:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2ceeaf4400 uarg=0000000000000000 20000000:01000000:1.0:1789351319.990732:0:14715:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789351319.990742:0:14715:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789351319.990748:0:14715:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789351319.991769:0:14716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1789351319.991954:0:14715:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789351320.005241:0:14715:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789351320.006305:0:14715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2ceecd8e00/0xa6ea017771df7d17 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351320.006340:0:14715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ceecc4c00/0xa6ea017771df7cdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7cd8 expref: 11 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351320.006349:0:14715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2ceecd8e00/0xa6ea017771df7d17 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351320.006519:0:14715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ceecc4c00/0xa6ea017771df7cdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df7cd8 expref: 11 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351320.006537:0:14715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2ceecc4c00/0xa6ea017771df7cdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df7cd8 expref: 11 pid: 14278 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351320.006551:0:14715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee14e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14715:1876270626446720:0@lo:104: 00000100:00100000:0.0:1789351320.006614:0:14715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351320.006660:0:14715:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc4572b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789351320.008677:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626446720 00000100:00100000:3.0:1789351320.008699:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626446720 00000100:00100000:3.0:1789351320.008816:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789351320.008830:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+3:14715:x1876270626446720:12345-0@lo:104: 00010000:00010000:3.0:1789351320.008856:0:14267:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8000/0xa6ea017771df7cd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df7cdf expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351320.008985:0:14267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789351320.008992:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+3:14715:x1876270626446720:12345-0@lo:104: Request processed in 165us (2378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351320.009000:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789351320.009013:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789351320.009028:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8000/0xa6ea017771df7cd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df7cdf expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351320.009041:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8000 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:1.0:1789351320.009046:0:14272:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8000/0xa6ea017771df7cd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df7cdf expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351320.009056:0:14272:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8000/0xa6ea017771df7cd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df7cdf expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789351320.009076:0:14272:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8000/0xa6ea017771df7cd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df7cdf expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351320.009081:0:14272:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789351320.009133:0:14272:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8000/0xa6ea017771df7cd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7cdf expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351320.009152:0:14272:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789351320.009181:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8000/0xa6ea017771df7cd8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7cdf expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351320.009189:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8000/0xa6ea017771df7cd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7cdf expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351320.009208:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351320.009210:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351320.009211:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351320.009230:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789351320.009247:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3286:1876270626446848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789351320.009320:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351320.009422:0:14270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626446848 00000100:00100000:3.0:1789351320.009429:0:14270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626446848 00010000:00010000:3.0:1789351320.009455:0:14270:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ceecc4c00/0xa6ea017771df7cdf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df7cd8 expref: 12 pid: 14278 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351320.009486:0:14270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789351320.009541:0:14270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:3286:x1876270626446848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789351320.009554:0:14270:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351320.009561:0:14270:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ceecc4c00/0xa6ea017771df7cdf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df7cd8 expref: 12 pid: 14278 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351320.009577:0:14270:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ceecc4c00/0xa6ea017771df7cdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df7cd8 expref: 12 pid: 14278 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351320.009603:0:14270:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2ceecd8e00/0xa6ea017771df7d17 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351320.009610:0:14715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ceecc4c00/0xa6ea017771df7cdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df7cd8 expref: 12 pid: 14278 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351320.009631:0:14715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee14e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14715:1876270626446720:0@lo:104: 00010000:00010000:3.0:1789351320.009634:0:14270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecd8e00/0xa6ea017771df7d17 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351320.009657:0:14715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2ceecd8e00/0xa6ea017771df7d17 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351320.009661:0:14270:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2ceecd8e00/0xa6ea017771df7d17 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351320.009687:0:14270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2ceecd8e00/0xa6ea017771df7d17 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351320.009688:0:14715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff8d2ceecd8e00/0xa6ea017771df7d17 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351320.009720:0:14270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2ceecd8e00/0xa6ea017771df7d17 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351320.009722:0:14715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2ceecd8e00/0xa6ea017771df7d17 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351320.009749:0:14270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2ceecd8e00/0xa6ea017771df7d17 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351320.009758:0:14270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8e00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351320.009764:0:14270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2ceecd8e00/0xa6ea017771df7d17 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351320.009773:0:14270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2ceecd8e00/0xa6ea017771df7d17 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351320.009785:0:14270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2ceecd8e00/0xa6ea017771df7d17 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351320.009795:0:14270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ceecd8e00/0xa6ea017771df7d17 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351320.009815:0:14270:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351320.009866:0:14270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+11:3286:x1876270626446848:12345-0@lo:103:ldlm_bl.0 Request processed in 372us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351320.009886:0:14270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789351320.009915:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3286:1876270626446848:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789351320.225733:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789351320.225745:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789351320.225749:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789351320.225753:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789351320.225756:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789351320.225760:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789351320.225764:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d2cc6fd4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789351320.225779:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d2cc6fd4800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789351320.225818:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2ceec44a80 x1876270626446976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789351320.226715:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876270626446976:0@lo:38:kworker.0 00000100:00100000:0.0:1789351320.226799:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351320.227027:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626446976 00000100:00100000:2.0:1789351320.227035:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626446976 00000100:00100000:2.0:1789351320.227076:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789351320.227084:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1876270626446976:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789351320.227111:0:14285:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1789351320.227158:0:14285:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa6ea017771df7d1e 00000004:00100000:2.0:1789351320.227180:0:14285:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789351320.227310:0:14285:0:(import.c:65:import_set_state_nolock()) ffff8d2cc5aaf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789351320.227607:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876270626446976:12345-0@lo:38:kworker.0 Request processed in 520us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351320.227616:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789351320.228310:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2ceec44a80 x1876270626446976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789351330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789351320.228327:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789351320.228334:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789351320.228339:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789351320.228341:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2cc6fd4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789351320.228347:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876270626446976:0@lo:38:kworker.0 00010000:00010000:1.0:1789351320.801657:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789351321.569432:0:14280:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789351321.569442:0:14280:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2cffaea000 from 10 10000000:01000000:1.0:1789351321.569448:0:14280:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789351321.569508:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5e00/0xa6ea017771df7d25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351321.569519:0:14280:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5e00/0xa6ea017771df7d25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351321.569547:0:14280:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5e00/0xa6ea017771df7d25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351321.569576:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626447104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789351321.569655:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351321.569710:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc462ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789351321.569813:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626447104 00000100:00100000:3.0:1789351321.569820:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626447104 00000100:00100000:3.0:1789351321.569877:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789351321.569886:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+11:14280:x1876270626447104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789351321.569904:0:14278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351321.569928:0:14278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cc3104e00/0xa6ea017771df7d2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7d25 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351321.569956:0:14278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cc3104e00/0xa6ea017771df7d2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7d25 expref: 12 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351321.569965:0:14278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cc3104e00/0xa6ea017771df7d2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7d25 expref: 12 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351321.569974:0:14278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104e00, rc 0) 00000100:00100000:3.0:1789351321.570008:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14280:x1876270626447104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351321.570013:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789351321.570238:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626447104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789351321.570255:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5e00/0xa6ea017771df7d25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d2c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351321.570266:0:14280:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5e00/0xa6ea017771df7d25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7d2c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351321.570335:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626447232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351321.570475:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351321.570544:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc462ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789351321.570584:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626447232 00000100:00100000:0.0:1789351321.570590:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626447232 00000100:00100000:0.0:1789351321.570626:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789351321.570635:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14280:x1876270626447232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351321.570965:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14280:x1876270626447232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351321.570973:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789351321.571330:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626447232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351321.571402:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626447360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351321.571453:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351321.571479:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc462ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789351321.571560:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626447360 00000100:00100000:2.0:1789351321.571567:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626447360 00000100:00100000:2.0:1789351321.571598:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789351321.571608:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14280:x1876270626447360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789351321.571803:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14280:x1876270626447360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351321.571810:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789351321.571922:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626447360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789351321.573280:0:14834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789351321.573716:0:14280:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789351321.573740:0:14280:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789351321.573755:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5e00/0xa6ea017771df7d25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d2c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351321.573789:0:14280:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5e00/0xa6ea017771df7d25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d2c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351321.826149:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351322.851157:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789351323.119278:0:14963:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789351323.119283:0:14963:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789351323.119420:0:14963:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8d2bc13e0800 00000020:01000004:2.0:1789351323.119436:0:14963:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789351323.119448:0:14963:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789351323.119489:0:14963:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d2cc30819c0) 00000020:00000080:2.0:1789351323.119506:0:14963:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789351323.140391:0:14963:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789351323.140691:0:14963:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789351323.146591:0:14963:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789351323.146851:0:14963:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789351323.147079:0:14963:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789351323.147491:0:14963:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 571: rc = 0 00100000:10000000:3.0:1789351323.147579:0:14963:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 571: rc = 0 00100000:10000000:3.0:1789351323.147706:0:14963:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 571: rc = 0 00100000:10000000:3.0:1789351323.148082:0:14963:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 775: rc = 0 00100000:10000000:3.0:1789351323.148443:0:14963:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 775: rc = 0 00100000:10000000:3.0:1789351323.148679:0:14963:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 775: rc = 0 00100000:10000000:3.0:1789351323.148922:0:14963:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 775: rc = 0 00100000:10000000:3.0:1789351323.152414:0:14963:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 775: rc = 0 00100000:10000000:3.0:1789351323.152715:0:14963:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 775: rc = 0 00000020:00000080:3.0:1789351323.153272:0:14963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789351323.153285:0:14963:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789351323.153297:0:14963:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa6ea017771df7d3a 00000020:01000004:3.0:1789351323.153306:0:14963:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789351323.153329:0:14963:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789351323.153333:0:14963:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789351323.153338:0:14963:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789351323.153343:0:14963:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789351323.153354:0:14963:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d2ce9deb380) 00000020:00000080:3.0:1789351323.153408:0:14963:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789351323.154587:0:14963:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789351323.154797:0:14963:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789351323.154804:0:14963:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789351323.158771:0:14963:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789351323.158783:0:14963:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789351323.162026:0:14963:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789351323.162039:0:14963:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789351323.167751:0:14963:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789351323.167942:0:14963:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789351323.167948:0:14963:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789351323.173753:0:14963:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789351323.175449:0:14963:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789351323.203809:0:14963:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789351323.204031:0:14963:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789351323.204037:0:14963:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789351323.205661:0:14963:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789351323.205672:0:14963:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789351323.208514:0:14963:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789351323.208527:0:14963:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789351323.212289:0:14963:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789351323.212503:0:14963:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789351323.212510:0:14963:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789351323.213809:0:14963:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789351323.213819:0:14963:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789351323.250837:0:14963:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789351323.251121:0:14963:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789351323.251129:0:14963:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789351323.252633:0:14963:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789351323.252645:0:14963:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789351323.253187:0:14963:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789351323.253212:0:14963:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789351323.253218:0:14963:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789351323.264236:0:14963:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789351323.264277:0:14963:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.152@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789351323.264282:0:14963:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789351323.264284:0:14963:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789351323.264285:0:14963:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789351323.264286:0:14963:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789351323.264287:0:14963:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789351323.264289:0:14963:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789351323.264290:0:14963:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789351323.264291:0:14963:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789351323.264293:0:14963:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789351323.264296:0:14963:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789351323.264298:0:14963:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789351323.264299:0:14963:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789351323.264300:0:14963:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789351323.264301:0:14963:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789351323.264302:0:14963:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789351323.264303:0:14963:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789351323.264304:0:14963:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789351323.264305:0:14963:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789351323.264306:0:14963:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789351323.264448:0:14963:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789351323.264474:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626447488:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789351323.264597:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351323.264654:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626447488 00000100:00100000:3.0:1789351323.264662:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626447488 00000100:00100000:0.0:1789351323.264702:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc462ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789351323.264815:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789351323.264826:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14963:x1876270626447488:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789351323.264859:0:14278:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789351323.264862:0:14278:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789351323.264865:0:14278:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789351323.268651:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14963:x1876270626447488:12345-0@lo:253:mount.lustre.0 Request processed in 3817us (4043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351323.268665:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789351323.268676:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626447488:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789351323.268692:0:14963:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789351323.268710:0:14963:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789351323.268712:0:14963:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789351323.268713:0:14963:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789351323.268714:0:14963:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789351323.268715:0:14963:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789351323.268717:0:14963:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789351323.268718:0:14963:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789351323.268720:0:14963:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789351323.268721:0:14963:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789351323.268804:0:14963:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2bc13e0800 from lustre-OST0000 10000000:01000000:2.0:1789351323.268825:0:14963:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789351323.268827:0:14963:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789351323.268832:0:14963:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2ce9decd40 local copy 00010000:00010000:2.0:1789351323.268842:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104600/0xa6ea017771df7c30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7c37 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351323.269013:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626447616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789351323.269039:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351323.269950:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626447616 00000100:00100000:1.0:1789351323.269959:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626447616 00000100:00100000:2.0:1789351323.269967:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc503a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789351323.269993:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789351323.270001:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14963:x1876270626447616:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789351323.270180:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14963:x1876270626447616:12345-0@lo:501:mount.lustre.0 Request processed in 179us (1138us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789351323.270188:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789351323.270209:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626447616:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789351323.270223:0:14963:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789351323.270322:0:14963:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789351323.270328:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104600/0xa6ea017771df7c30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7c37 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.270337:0:14963:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104600/0xa6ea017771df7c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7c37 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351323.270406:0:14963:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2bc13e0800 10000000:01000000:2.0:1789351323.270411:0:14963:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789351323.270415:0:14963:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d2ce9decd40 10000000:01000000:2.0:1789351323.270421:0:14963:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789351323.270424:0:14963:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8d2ce9decd40 from 1 10000000:01000000:2.0:1789351323.270426:0:14963:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789351323.270448:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0600/0xa6ea017771df7d48 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.270454:0:14963:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0600/0xa6ea017771df7d48 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.270461:0:14963:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0600/0xa6ea017771df7d48 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351323.270470:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626447744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789351323.270490:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351323.270549:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc503a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789351323.270581:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626447744 00000100:00100000:0.0:1789351323.270584:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626447744 00000100:00100000:0.0:1789351323.270606:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789351323.270617:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+12:14963:x1876270626447744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789351323.270625:0:14278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351323.270638:0:14278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecd9000/0xa6ea017771df7d4f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7d48 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351323.270658:0:14278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecd9000/0xa6ea017771df7d4f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7d48 expref: 13 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351323.270668:0:14278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecd9000/0xa6ea017771df7d4f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7d48 expref: 13 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351323.270676:0:14278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9000, rc 0) 00000100:00100000:0.0:1789351323.270705:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+13:14963:x1876270626447744:12345-0@lo:101:mount.lustre.0 Request processed in 89us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351323.270711:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789351323.270720:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626447744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789351323.270732:0:14963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0600/0xa6ea017771df7d48 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d4f expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.270741:0:14963:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0600/0xa6ea017771df7d48 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7d4f expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351323.270755:0:14963:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789351323.270770:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0600/0xa6ea017771df7d48 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d4f expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.270777:0:14963:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0600/0xa6ea017771df7d48 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d4f expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351323.270784:0:14963:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789351323.270793:0:14963:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789351323.270797:0:14963:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789351323.270799:0:14963:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789351323.270812:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1800/0xa6ea017771df7d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.270818:0:14963:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1800/0xa6ea017771df7d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.270825:0:14963:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1800/0xa6ea017771df7d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351323.270837:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626447872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789351323.270859:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351323.270873:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc503a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789351323.270885:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626447872 00000100:00100000:0.0:1789351323.270889:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626447872 00000100:00100000:0.0:1789351323.270913:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789351323.270929:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+13:14963:x1876270626447872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789351323.270946:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351323.270954:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecd9e00/0xa6ea017771df7d5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7d56 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351323.270967:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecd9e00/0xa6ea017771df7d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7d56 expref: 14 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351323.270975:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecd9e00/0xa6ea017771df7d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7d56 expref: 14 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351323.270982:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9e00, rc 0) 00000100:00100000:0.0:1789351323.271009:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+14:14963:x1876270626447872:12345-0@lo:101:mount.lustre.0 Request processed in 90us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351323.271015:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789351323.271023:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626447872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789351323.271032:0:14963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1800/0xa6ea017771df7d56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d5d expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.271040:0:14963:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1800/0xa6ea017771df7d56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7d5d expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789351323.271519:0:14963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789351323.272069:0:14963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789351323.272242:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789351323.272269:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789351323.272286:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789351323.272323:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789351323.272388:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789351323.272432:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789351323.272501:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789351323.272508:0:14963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789351323.272548:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626448000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789351323.272578:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351323.272606:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc4572c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789351323.272621:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626448000 00000100:00100000:0.0:1789351323.272626:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626448000 00000100:00100000:0.0:1789351323.272662:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789351323.272670:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+14:14963:x1876270626448000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789351323.272914:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+14:14963:x1876270626448000:12345-0@lo:501:mount.lustre.0 Request processed in 244us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351323.272932:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789351323.272937:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626448000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789351323.272961:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626448128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789351323.272996:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351323.273020:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc4572c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789351323.273277:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626448128 00000100:00100000:0.0:1789351323.273282:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626448128 00000100:00100000:0.0:1789351323.273303:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789351323.273309:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+14:14963:x1876270626448128:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789351323.273595:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+14:14963:x1876270626448128:12345-0@lo:503:mount.lustre.0 Request processed in 285us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351323.273611:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789351323.273614:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626448128:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789351323.274053:0:14963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789351323.274104:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626448256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789351323.274129:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351323.274152:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc4572c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789351323.274167:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626448256 00000100:00100000:0.0:1789351323.274172:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626448256 00000100:00100000:0.0:1789351323.274195:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789351323.274201:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+14:14963:x1876270626448256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789351323.274418:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+14:14963:x1876270626448256:12345-0@lo:502:mount.lustre.0 Request processed in 216us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351323.274425:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789351323.274433:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626448256:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789351323.274692:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789351323.274734:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789351323.274767:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789351323.274814:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789351323.274849:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789351323.274878:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789351323.274921:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789351323.274956:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789351323.274991:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789351323.275050:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789351323.275096:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789351323.275144:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789351323.275176:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626448384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789351323.275213:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351323.275246:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc4572c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789351323.275304:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626448384 00000100:00100000:0.0:1789351323.275309:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626448384 00000100:00100000:0.0:1789351323.275379:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789351323.275386:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+14:14963:x1876270626448384:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789351323.275535:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+14:14963:x1876270626448384:12345-0@lo:502:mount.lustre.0 Request processed in 149us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351323.275542:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789351323.275623:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626448384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789351323.275696:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789351323.275704:0:14963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789351323.276669:0:14977:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789351323.276677:0:14977:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789351323.276684:0:14977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351323.276687:0:14977:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789351323.276695:0:14977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789351323.276709:0:14977:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d2ce9de99c0) 00000020:00000080:3.0:1789351323.276729:0:14977:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789351323.276734:0:14977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789351323.276810:0:14977:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2bc13e0800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789351323.276817:0:14977:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789351323.276824:0:14977:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa6ea017771df7d6b 00010000:00010000:3.0:1789351323.280595:0:14977:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789351323.280958:0:14977:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1789351323.282642:0:14977:0:(osd_index.c:2105:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1789351323.283748:0:14977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789351323.283759:0:14977:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351323.283764:0:14977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351323.283766:0:14977:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789351323.283769:0:14977:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789351323.283772:0:14977:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1789351323.283773:0:14977:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789351323.283775:0:14977:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789351323.283776:0:14977:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789351323.283778:0:14977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351323.283779:0:14977:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789351323.283782:0:14977:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789351323.283785:0:14977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351323.283786:0:14977:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789351323.283790:0:14977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789351323.283792:0:14977:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789351323.283794:0:14977:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351323.283802:0:14977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351323.283803:0:14977:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789351323.283806:0:14977:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789351323.283809:0:14977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351323.283810:0:14977:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789351323.283813:0:14977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789351323.283858:0:14977:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789351323.283861:0:14977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351323.283862:0:14977:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789351323.283864:0:14977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789351323.283983:0:14963:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789351323.284005:0:14963:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789351323.284022:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1800/0xa6ea017771df7d56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d5d expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351323.284030:0:14963:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1800/0xa6ea017771df7d56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d5d expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351323.284035:0:14963:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2bc13e0800 from 1 10000000:01000000:0.0:1789351323.284037:0:14963:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789351323.284064:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df7d72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351323.284077:0:14963:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df7d72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351323.284094:0:14963:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df7d72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351323.284114:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626448512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789351323.284170:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351323.284205:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce02cdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789351323.284270:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626448512 00000100:00100000:3.0:1789351323.284275:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626448512 00000100:00100000:3.0:1789351323.284309:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789351323.284316:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+14:14963:x1876270626448512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789351323.284326:0:14278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351323.284337:0:14278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2cc3104200/0xa6ea017771df7d79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7d72 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.284390:0:14278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2cc3104200/0xa6ea017771df7d79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7d72 expref: 15 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.284400:0:14278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2cc3104200/0xa6ea017771df7d79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7d72 expref: 15 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.284406:0:14278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cc3104200, rc 0) 00000100:00100000:3.0:1789351323.284436:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+15:14963:x1876270626448512:12345-0@lo:101:mount.lustre.0 Request processed in 121us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351323.284441:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789351323.284507:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee15f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626448512:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789351323.284519:0:14963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df7d72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d79 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351323.284525:0:14963:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df7d72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7d79 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789351323.284938:0:14963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789351323.285226:0:14963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789351323.285490:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789351323.285530:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789351323.285585:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789351323.285592:0:14963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789351323.285642:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626448640:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789351323.285682:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351323.285708:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda283480 going to sleep for 11 seconds 00000100:00100000:0.0:1789351323.285912:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626448640 00000100:00100000:0.0:1789351323.285917:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626448640 00000100:00100000:0.0:1789351323.285952:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789351323.285960:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+15:14963:x1876270626448640:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789351323.286132:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+15:14963:x1876270626448640:12345-0@lo:501:mount.lustre.0 Request processed in 172us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351323.286139:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789351323.286152:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626448640:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789351323.286180:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626448768:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789351323.286215:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351323.286236:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda283480 going to sleep for 11 seconds 00000100:00100000:0.0:1789351323.286242:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626448768 00000100:00100000:0.0:1789351323.286246:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626448768 00000100:00100000:0.0:1789351323.286315:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789351323.286322:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+15:14963:x1876270626448768:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789351323.286466:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+15:14963:x1876270626448768:12345-0@lo:503:mount.lustre.0 Request processed in 144us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351323.286473:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789351323.286495:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626448768:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789351323.287111:0:14963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789351323.287167:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626448896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789351323.287203:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351323.291872:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc4572b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789351323.292097:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626448896 00000100:00100000:1.0:1789351323.292107:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626448896 00000100:00100000:1.0:1789351323.292160:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789351323.292169:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+15:14963:x1876270626448896:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789351323.292449:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+15:14963:x1876270626448896:12345-0@lo:502:mount.lustre.0 Request processed in 280us (5244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351323.292458:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789351323.292487:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626448896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789351323.292900:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789351323.292956:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789351323.293006:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789351323.293047:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789351323.293082:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789351323.293144:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789351323.293190:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789351323.293225:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789351323.293262:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626449024:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789351323.293311:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351323.293337:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda283d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789351323.293413:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626449024 00000100:00100000:0.0:1789351323.293419:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626449024 00000100:00100000:0.0:1789351323.293568:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789351323.293585:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+15:14963:x1876270626449024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789351323.293743:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+15:14963:x1876270626449024:12345-0@lo:502:mount.lustre.0 Request processed in 159us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351323.293750:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789351323.293821:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626449024:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789351323.293900:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789351323.293909:0:14963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789351323.294819:0:14981:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789351323.294829:0:14981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351323.294832:0:14981:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789351323.294838:0:14981:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2bc13e0800 00000020:00000080:1.0:1789351323.294840:0:14981:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789351323.294846:0:14981:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789351323.294849:0:14981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351323.294851:0:14981:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789351323.294853:0:14981:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789351323.294855:0:14981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351323.294857:0:14981:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789351323.294860:0:14981:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2bc13e0800 00000020:00000080:1.0:1789351323.294861:0:14981:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789351323.294920:0:14981:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789351323.294923:0:14981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351323.294924:0:14981:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789351323.294926:0:14981:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789351323.294929:0:14981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351323.294930:0:14981:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789351323.294933:0:14981:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2bc13e0800 00000020:00000080:1.0:1789351323.294935:0:14981:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789351323.294962:0:14981:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789351323.294965:0:14981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351323.294967:0:14981:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789351323.294975:0:14981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789351323.295129:0:14963:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789351323.295148:0:14963:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789351323.295194:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df7d72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d79 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.295204:0:14963:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df7d72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d79 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351323.295245:0:14963:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789351323.295248:0:14963:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2bc13e0800 10000000:01000000:2.0:1789351323.295251:0:14963:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2bc13e0800 10000000:01000000:2.0:1789351323.295255:0:14963:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789351323.295260:0:14963:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d2bc13e0800 from 1 10000000:01000000:2.0:1789351323.295263:0:14963:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789351323.295290:0:14963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1400/0xa6ea017771df7d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.295299:0:14963:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1400/0xa6ea017771df7d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.295319:0:14963:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1400/0xa6ea017771df7d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351323.295339:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626449152:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789351323.295405:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351323.295482:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc4572000 going to sleep for 11 seconds 00000100:00100000:0.0:1789351323.295738:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626449152 00000100:00100000:0.0:1789351323.295744:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626449152 00000100:00100000:0.0:1789351323.295785:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789351323.295793:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+15:14963:x1876270626449152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789351323.295805:0:14277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351323.295818:0:14277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecd9c00/0xa6ea017771df7d87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7d80 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351323.295840:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecd9c00/0xa6ea017771df7d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7d80 expref: 16 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351323.295850:0:14277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecd9c00/0xa6ea017771df7d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7d80 expref: 16 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351323.295858:0:14277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9c00, rc 0) 00000100:00100000:0.0:1789351323.295895:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:14963:x1876270626449152:12345-0@lo:101:mount.lustre.0 Request processed in 103us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351323.295901:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789351323.296100:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626449152:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789351323.296114:0:14963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1400/0xa6ea017771df7d80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d87 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.296124:0:14963:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1400/0xa6ea017771df7d80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7d87 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789351323.296796:0:14963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789351323.297073:0:14963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789351323.297329:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789351323.297710:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789351323.297749:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789351323.297799:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789351323.297832:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789351323.297878:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789351323.297928:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789351323.297965:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789351323.298013:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789351323.298048:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789351323.298078:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789351323.298138:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789351323.298173:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789351323.298205:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789351323.298262:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789351323.298297:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789351323.298328:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789351323.298484:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789351323.298598:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789351323.298635:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789351323.298698:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789351323.298736:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789351323.298784:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789351323.298834:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789351323.298867:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789351323.298899:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789351323.298953:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789351323.298990:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789351323.299072:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789351323.299079:0:14963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789351323.299187:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626449280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789351323.299253:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351323.299397:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc4572000 going to sleep for 11 seconds 00000100:00100000:0.0:1789351323.299488:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626449280 00000100:00100000:0.0:1789351323.299496:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626449280 00000100:00100000:0.0:1789351323.299648:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789351323.299658:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:14963:x1876270626449280:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789351323.299892:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:14963:x1876270626449280:12345-0@lo:501:mount.lustre.0 Request processed in 235us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351323.299910:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789351323.299980:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626449280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789351323.300012:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626449408:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789351323.300051:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351323.300138:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda2830c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789351323.300177:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626449408 00000100:00100000:2.0:1789351323.300182:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626449408 00000100:00100000:2.0:1789351323.300200:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789351323.300206:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:14963:x1876270626449408:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789351323.300345:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:14963:x1876270626449408:12345-0@lo:503:mount.lustre.0 Request processed in 138us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351323.300351:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789351323.300454:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626449408:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789351323.300972:0:14963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789351323.301023:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626449536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789351323.301060:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351323.301101:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda2830c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789351323.301146:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626449536 00000100:00100000:2.0:1789351323.301151:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626449536 00000100:00100000:2.0:1789351323.301174:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789351323.301180:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:14963:x1876270626449536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789351323.301341:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:14963:x1876270626449536:12345-0@lo:502:mount.lustre.0 Request processed in 160us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351323.301348:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789351323.301461:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626449536:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789351323.301729:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789351323.301768:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789351323.301800:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789351323.301850:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789351323.301885:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789351323.301925:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789351323.301957:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789351323.301987:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789351323.302042:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789351323.302097:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789351323.302130:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789351323.302175:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789351323.302208:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789351323.302240:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789351323.302284:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789351323.302318:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789351323.302351:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789351323.302440:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789351323.302474:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789351323.302634:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789351323.302686:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789351323.302725:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789351323.302762:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789351323.302808:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789351323.302845:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789351323.302894:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789351323.302943:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789351323.302975:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789351323.303003:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789351323.303063:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789351323.303725:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789351323.303766:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789351323.303799:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789351323.303850:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789351323.303886:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789351323.304620:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789351323.304670:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789351323.304724:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789351323.304776:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789351323.304813:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789351323.304861:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626449664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789351323.304934:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351323.304979:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda2830c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789351323.305256:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626449664 00000100:00100000:2.0:1789351323.305263:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626449664 00000100:00100000:2.0:1789351323.305310:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789351323.305319:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:14963:x1876270626449664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789351323.305725:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:14963:x1876270626449664:12345-0@lo:502:mount.lustre.0 Request processed in 406us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351323.305733:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789351323.306614:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626449664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789351323.306720:0:14963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789351323.306734:0:14963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789351323.308778:0:14984:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789351323.308795:0:14984:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d2cffbdb380) 00000020:00000080:1.0:1789351323.308821:0:14984:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789351323.309008:0:14984:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2bc13e0800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789351323.309013:0:14984:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2bc13e0800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789351323.309015:0:14984:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2bc13e0800 3 00010000:00080000:1.0:1789351323.309043:0:14984:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2cffa6e800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.152@tcp at head 00010000:00010000:1.0:1789351323.310791:0:14984:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1789351323.310883:0:14984:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789351323.310915:0:14984:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789351323.310926:0:14984:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa6ea017771df7d95 00000100:00080000:1.0:1789351323.310936:0:14984:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789351323.310942:0:14984:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d2cffa6e800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789351323.310974:0:14984:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2cffb64380 x1876270626449792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789351323.311007:0:14984:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789351323.311035:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789351323.311040:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789351323.311043:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789351323.311046:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789351323.311112:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1876270626449792:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789351323.311182:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351323.311279:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626449792 00000100:00100000:1.0:1789351323.311284:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876270626449920:0@lo:400:kworker.0 00000100:00100000:0.0:1789351323.311286:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626449792 00000100:00100000:1.0:1789351323.311311:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351323.311311:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789351323.311319:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1876270626449792:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789351323.311457:0:14283:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:0.0:1789351323.311485:0:14283:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa6ea017771df7d9c 00000004:00100000:0.0:1789351323.311497:0:14283:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789351323.311596:0:14283:0:(import.c:65:import_set_state_nolock()) ffff8d2cd85af800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789351323.311648:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876270626449792:12345-0@lo:38:llog_process_th.0 Request processed in 328us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351323.311655:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789351323.311669:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626449920 00000100:00100000:0.0:1789351323.311672:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626449920 00000100:00100000:0.0:1789351323.311692:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351323.311698:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876270626449920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351323.311746:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876270626449920:12345-0@lo:400:kworker.0 Request processed in 48us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351323.311752:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789351323.311785:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2ceee16680 x1876270626449920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351323.311803:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876270626449920:0@lo:400:kworker.0 00010000:00080000:0.0:1789351323.311831:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2cffb64380 x1876270626449792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789351333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351323.311837:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789351323.311842:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789351323.311848:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789351323.311852:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789351323.311854:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2cffa6e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789351323.311859:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1876270626449792:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789351323.320219:0:14984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789351323.320611:0:14963:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789351323.320642:0:14963:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789351323.320665:0:14963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1400/0xa6ea017771df7d80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d87 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.321421:0:14963:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1400/0xa6ea017771df7d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7d87 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789351323.321468:0:14963:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789351323.321470:0:14963:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789351323.321472:0:14963:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789351323.321473:0:14963:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789351323.321474:0:14963:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789351323.321476:0:14963:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789351323.321477:0:14963:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789351323.321479:0:14963:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789351323.321481:0:14963:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789351323.321485:0:14963:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789351323.321487:0:14963:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789351323.321488:0:14963:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789351323.321489:0:14963:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789351323.321490:0:14963:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789351323.321491:0:14963:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789351323.321492:0:14963:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789351323.321493:0:14963:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789351323.321494:0:14963:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789351323.321495:0:14963:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789351323.321521:0:14963:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789351323.321541:0:14963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626450048:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789351323.321614:0:14963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351323.321655:0:14963:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789351323.321670:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626450048 00000100:00100000:0.0:1789351323.321679:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626450048 00000100:00100000:0.0:1789351323.321720:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789351323.321730:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:14963:x1876270626450048:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789351323.321756:0:14278:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789351323.321768:0:14278:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789351323.363693:0:14278:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789351323.363705:0:14278:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789351323.365994:0:14299:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789351323.366005:0:14299:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789351323.366029:0:14299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7da3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.366050:0:14299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cc3104400/0xa6ea017771df7d10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7d09 expref: 16 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.366059:0:14299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7da3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.366114:0:14299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cc3104400/0xa6ea017771df7d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df7d09 expref: 16 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.366130:0:14299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2cc3104400/0xa6ea017771df7d10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df7d09 expref: 16 pid: 14278 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351323.366167:0:14299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14299:1876270626450176:0@lo:104: 00000100:00100000:2.0:1789351323.366237:0:14299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351323.366301:0:14299:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd85f0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789351323.366476:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626450176 00000100:00100000:3.0:1789351323.366485:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626450176 00000100:00100000:3.0:1789351323.366533:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789351323.366543:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+3:14299:x1876270626450176:12345-0@lo:104: 00010000:00010000:3.0:1789351323.366557:0:14266:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4800/0xa6ea017771df7d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df7d10 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.366621:0:14266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789351323.366627:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+3:14299:x1876270626450176:12345-0@lo:104: Request processed in 86us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351323.366634:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789351323.366656:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351323.366662:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4800/0xa6ea017771df7d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df7d10 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.366669:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4800 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:3.0:1789351323.366673:0:14272:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4800/0xa6ea017771df7d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df7d10 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.366682:0:14272:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4800/0xa6ea017771df7d09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df7d10 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789351323.366689:0:14272:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4800/0xa6ea017771df7d09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df7d10 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351323.366695:0:14272:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789351323.366722:0:14272:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4800/0xa6ea017771df7d09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7d10 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.366728:0:14272:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789351323.366747:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4800/0xa6ea017771df7d09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7d10 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.366753:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4800/0xa6ea017771df7d09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7d10 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.366777:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351323.366778:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351323.366779:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789351323.366887:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3289:1876270626450304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789351323.366915:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351323.366958:0:14299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14299:1876270626450176:0@lo:104: 00010000:00010000:2.0:1789351323.366975:0:14299:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7da3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351323.367032:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626450304 00000100:00100000:3.0:1789351323.367036:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626450304 00010000:00010000:3.0:1789351323.367052:0:14268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cc3104400/0xa6ea017771df7d10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df7d09 expref: 17 pid: 14278 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351323.367073:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789351323.367079:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffada680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:3289:x1876270626450304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789351323.367101:0:14268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351323.367106:0:14268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cc3104400/0xa6ea017771df7d10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df7d09 expref: 17 pid: 14278 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.367116:0:14268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cc3104400/0xa6ea017771df7d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df7d09 expref: 17 pid: 14278 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.367129:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cc3104400/0xa6ea017771df7d10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df7d09 expref: 17 pid: 14278 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.367141:0:14268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7da3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.367149:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7da3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789351323.367162:0:14268:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002740836s 00010000:00010000:3.0:1789351323.367166:0:14268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7da3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.367183:0:14268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7da3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.367190:0:14268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7da3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.367196:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7da3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.367201:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1600 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351323.367205:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7da3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.367212:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7da3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.367232:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7da3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351323.367242:0:14268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351323.367272:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffada680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:3289:x1876270626450304:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351323.367278:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789351323.368778:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3289:1876270626450304:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789351323.368808:0:14299:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7da3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.368817:0:14299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7da3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351323.368823:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7da3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351323.371081:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+15:14963:x1876270626450048:12345-0@lo:253:mount.lustre.0 Request processed in 49347us (49460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351323.371105:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789351323.371183:0:14963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14963:1876270626450048:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789351323.371197:0:14963:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789351323.371200:0:14963:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789351323.371202:0:14963:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789351323.371203:0:14963:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789351323.371204:0:14963:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789351323.371206:0:14963:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789351323.371219:0:14963:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789351323.371220:0:14963:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789351323.371222:0:14963:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789351323.371223:0:14963:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789351323.371236:0:14963:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789351323.378777:0:14963:0:(osd_index.c:2105:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789351323.378929:0:14963:0:(osd_index.c:2105:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789351323.379103:0:14963:0:(osd_index.c:2105:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789351323.379266:0:14963:0:(osd_index.c:2105:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789351323.379455:0:14963:0:(osd_index.c:2105:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789351323.379621:0:14963:0:(osd_index.c:2105:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789351323.380861:0:14963:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789351323.406859:0:14963:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789351323.406868:0:14963:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789351323.406897:0:14963:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789351323.406947:0:14963:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789351323.406959:0:14963:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789351323.406985:0:14963:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789351323.877579:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351324.321657:0:3285:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789351314/real 1789351314] req@ffff8d2ceec44380 x1876270626444160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789351324 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351324.321691:0:3285:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2ceec44380 x1876270626444160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789351324 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351324.321715:0:3285:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789351314/real 1789351314] req@ffff8d2ceee15500 x1876270626444032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789351324 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351324.321729:0:3285:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2ceee15500 x1876270626444032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789351324 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789351324.321748:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2cc308b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789351324.321776:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789351324.321788:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626444160:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789351324.321794:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2ceecd6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789351324.321799:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789351324.321802:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626444032:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789351324.321943:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789351324.321948:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789351324.321952:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2ceecd6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789351324.321957:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 259 00000100:00080000:0.0:1789351324.321963:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789351324.321970:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d2ceecd6000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789351324.321992:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2ceee16300 x1876270626450560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789351324.322013:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789351324.322017:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789351324.322019:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2cc308b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789351324.322022:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 259 00000100:00080000:0.0:1789351324.322024:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789351324.322029:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2cc308b000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:0.0:1789351324.322040:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2ceee15500 x1876270626450688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789351324.322105:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3286:1876270626450432:0@lo:400:kworker.0 00000100:00100000:0.0:1789351324.322173:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351324.322219:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789351324.322226:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626450816:0@lo:400:kworker.0 00000100:00100000:0.0:1789351324.322255:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351324.322301:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626450944:0@lo:400:kworker.0 00000100:00100000:0.0:1789351324.322323:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351324.322376:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626450432 00000100:00100000:0.0:1789351324.322384:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626450432 00000100:00100000:0.0:1789351324.322423:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789351324.322432:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+15:3286:x1876270626450432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351324.322479:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+15:3286:x1876270626450432:12345-0@lo:400:kworker.0 Request processed in 48us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351324.322487:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789351324.322518:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626450816 00000100:00100000:0.0:1789351324.322522:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626450816 00000100:00100000:0.0:1789351324.322555:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626450944 00000100:00100000:0.0:1789351324.322559:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626450944 00000100:00100000:0.0:1789351324.322584:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789351324.322590:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626450816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351324.322638:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626450816:12345-0@lo:400:kworker.0 Request processed in 47us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351324.322644:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789351324.322657:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789351324.322664:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626450944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351324.322695:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626450944:12345-0@lo:400:kworker.0 Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351324.322701:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789351324.322741:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2ceee15880 x1876270626450944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351324.322754:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626450944:0@lo:400:kworker.0 00000100:00100000:0.0:1789351324.322771:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626450560:0@lo:8:kworker.0 00000100:00100000:0.0:1789351324.322797:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351324.322818:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626450688:0@lo:8:kworker.0 00000100:00100000:0.0:1789351324.322840:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351324.322869:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626450560 00000100:00100000:0.0:1789351324.322872:0:14965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626450560 00000100:00100000:0.0:1789351324.322884:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626450688 00000100:00100000:0.0:1789351324.322886:0:14965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626450688 00000100:00100000:0.0:1789351324.322894:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351324.322899:0:14965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1876270626450560:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789351324.322920:0:14965:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:0.0:1789351324.322953:0:14965:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6ea017771df7daa 00002000:00100000:0.0:1789351324.322967:0:14965:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d2cd85ab800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789351324.322970:0:14965:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789351324.322973:0:14965:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789351324.323398:0:14965:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789351324.323418:0:14965:0:(import.c:65:import_set_state_nolock()) ffff8d2cd85ad000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789351324.323462:0:14965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1876270626450560:12345-0@lo:8:kworker.0 Request processed in 561us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351324.323470:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351324.323485:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789351324.323490:0:14965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1876270626450688:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789351324.323502:0:14965:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789351324.323526:0:14965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1876270626450688:12345-0@lo:8:kworker.0 Request processed in 34us (685us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789351324.323532:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789351324.323564:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2ceee15f80 x1876270626450816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351324.323575:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626450816:0@lo:400:kworker.0 00000100:00100000:0.0:1789351324.323585:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3286:1876270626450432:0@lo:400:kworker.0 00010000:00080000:0.0:1789351324.323681:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2ceee16300 x1876270626450560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789351339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789351324.323690:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789351324.323696:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789351324.323702:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789351324.323713:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789351324.323716:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2ceecd6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789351324.323737:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789351324.323742:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626450560:0@lo:8:kworker.0 00000100:00080000:0.0:1789351324.323755:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2cc308b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789351324.323758:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789351324.323761:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626450688:0@lo:8:kworker.0 00000004:00080000:0.0:1789351324.323803:0:14305:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789351324.324010:0:14305:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 268769651481ns, next at 0ns, rc = 0 00000004:00080000:2.0:1789351324.324332:0:14306:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1789351324.324355:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14306:1876270626451200:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789351324.324416:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351324.324447:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc5e2fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789351324.325109:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626451072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789351324.325138:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351324.325173:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626451200 00000100:00100000:0.0:1789351324.325179:0:14965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626451200 00000100:00100000:0.0:1789351324.325216:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789351324.325224:0:14965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14306:x1876270626451200:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789351324.327708:0:14965:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789351324.327716:0:14965:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789351324.327721:0:14965:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:1.0:1789351324.328557:0:14968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626451072 00000100:00100000:1.0:1789351324.328567:0:14968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626451072 00000100:00100000:1.0:1789351324.328627:0:14968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789351324.328638:0:14968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1876270626451072:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789351324.328647:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789351324.328654:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:1.0:1789351324.328662:0:14968:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789351324.328748:0:14968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1876270626451072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (3609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351324.328755:0:14968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789351324.329155:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2cffad9f80 x1876270626451072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351324.329175:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626451072:0@lo:13:osp-pre-0-0.0 00002000:00010000:0.0:1789351324.333259:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.333272:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df7db1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.333291:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.333296:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.333303:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df7db1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.333589:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df7db1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.333852:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df7db1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.333862:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df7db1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.333882:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789351324.333921:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351324.333929:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df7db1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.333940:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8200 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351324.333945:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df7db1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.333955:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df7db1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.333979:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df7db1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.333987:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005979887c/0xa6ea017771df7db1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.334020:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351324.334023:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351324.334026:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789351324.334769:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.334776:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036f207f0/0xa6ea017771df7db8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.334787:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.334791:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.334796:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036f207f0/0xa6ea017771df7db8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.334805:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036f207f0/0xa6ea017771df7db8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.334814:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036f207f0/0xa6ea017771df7db8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.334832:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036f207f0/0xa6ea017771df7db8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.334847:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789351324.335265:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.335271:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c18cc64/0xa6ea017771df7dbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.335280:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.335283:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.335288:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c18cc64/0xa6ea017771df7dbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.335297:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c18cc64/0xa6ea017771df7dbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.335395:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c18cc64/0xa6ea017771df7dbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.335406:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c18cc64/0xa6ea017771df7dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.335422:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789351324.335854:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789351324.335862:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036f207f0/0xa6ea017771df7db8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.335872:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9800 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351324.335876:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036f207f0/0xa6ea017771df7db8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.335884:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036f207f0/0xa6ea017771df7db8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.335898:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036f207f0/0xa6ea017771df7db8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.335905:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036f207f0/0xa6ea017771df7db8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.335922:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351324.335925:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c18cc64/0xa6ea017771df7dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.335932:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9600 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351324.335943:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c18cc64/0xa6ea017771df7dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.335951:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c18cc64/0xa6ea017771df7dbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.335962:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c18cc64/0xa6ea017771df7dbf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.335970:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c18cc64/0xa6ea017771df7dbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.335985:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351324.335987:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351324.335989:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351324.336049:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789351324.336079:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.336088:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7dc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.336103:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.336107:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.336112:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7dc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.336122:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7dc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.336130:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7dc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.336138:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7dc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.336376:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789351324.336463:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351324.336468:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7dc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.336476:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8600 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351324.336479:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7dc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.336487:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7dc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.336499:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7dc6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.336512:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065ab0161/0xa6ea017771df7dc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.336527:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351324.336529:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351324.336531:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789351324.336887:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.336893:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d7a0ad5/0xa6ea017771df7dcd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.336901:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.336904:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.336908:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d7a0ad5/0xa6ea017771df7dcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.336917:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d7a0ad5/0xa6ea017771df7dcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.336936:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d7a0ad5/0xa6ea017771df7dcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.336942:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d7a0ad5/0xa6ea017771df7dcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.336963:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789351324.337466:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.337472:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e2bd92b/0xa6ea017771df7dd4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.337481:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.337484:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.337489:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e2bd92b/0xa6ea017771df7dd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.337498:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e2bd92b/0xa6ea017771df7dd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.337506:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e2bd92b/0xa6ea017771df7dd4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.337514:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e2bd92b/0xa6ea017771df7dd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.337536:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789351324.337542:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789351324.337545:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d7a0ad5/0xa6ea017771df7dcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.337555:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9400 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351324.337560:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d7a0ad5/0xa6ea017771df7dcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.337568:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d7a0ad5/0xa6ea017771df7dcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.337580:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d7a0ad5/0xa6ea017771df7dcd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.337587:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d7a0ad5/0xa6ea017771df7dcd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.337602:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351324.337605:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e2bd92b/0xa6ea017771df7dd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.337618:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8400 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351324.337621:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e2bd92b/0xa6ea017771df7dd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.337629:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e2bd92b/0xa6ea017771df7dd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.337638:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e2bd92b/0xa6ea017771df7dd4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.337645:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e2bd92b/0xa6ea017771df7dd4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351324.337655:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351324.337657:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351324.337658:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351324.337664:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789351324.338045:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.338052:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008eff1f6b/0xa6ea017771df7ddb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.338064:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.338081:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.338086:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008eff1f6b/0xa6ea017771df7ddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.338097:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008eff1f6b/0xa6ea017771df7ddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.338106:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008eff1f6b/0xa6ea017771df7ddb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.338113:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008eff1f6b/0xa6ea017771df7ddb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.338128:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789351324.338773:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.338780:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca57715f/0xa6ea017771df7de2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.338789:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.338798:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.338803:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca57715f/0xa6ea017771df7de2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.338814:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca57715f/0xa6ea017771df7de2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.338822:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca57715f/0xa6ea017771df7de2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.338829:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca57715f/0xa6ea017771df7de2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.338846:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789351324.339239:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.339245:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df7de9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.339253:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.339256:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.339260:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df7de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.339269:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df7de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.339277:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df7de9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.339291:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df7de9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.339299:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789351324.340017:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.340025:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df7df0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.340036:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.340040:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.340044:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df7df0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.340055:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df7df0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.340064:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df7df0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.340085:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df7df0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.340095:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1789351324.340787:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.340795:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf80d25/0xa6ea017771df7df7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.340809:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.340813:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.340817:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bf80d25/0xa6ea017771df7df7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.340828:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bf80d25/0xa6ea017771df7df7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.340837:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf80d25/0xa6ea017771df7df7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.340846:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bf80d25/0xa6ea017771df7df7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.340857:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1789351324.340995:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789351324.341003:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008eff1f6b/0xa6ea017771df7ddb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.341019:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9200 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351324.341024:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008eff1f6b/0xa6ea017771df7ddb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.341034:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008eff1f6b/0xa6ea017771df7ddb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.341054:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008eff1f6b/0xa6ea017771df7ddb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.341062:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008eff1f6b/0xa6ea017771df7ddb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789351324.341779:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.341786:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eb88e08/0xa6ea017771df7dfe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.341796:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.341799:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.341803:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eb88e08/0xa6ea017771df7dfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.341813:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006eb88e08/0xa6ea017771df7dfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.341834:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eb88e08/0xa6ea017771df7dfe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.341842:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006eb88e08/0xa6ea017771df7dfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.341851:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1789351324.342693:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.342701:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd1ea51f/0xa6ea017771df7e05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.342711:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.342715:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.342720:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd1ea51f/0xa6ea017771df7e05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.342731:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd1ea51f/0xa6ea017771df7e05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.342739:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd1ea51f/0xa6ea017771df7e05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.342747:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd1ea51f/0xa6ea017771df7e05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.342768:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1789351324.342981:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789351324.342989:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca57715f/0xa6ea017771df7de2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.342998:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8e00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351324.343002:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca57715f/0xa6ea017771df7de2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343011:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca57715f/0xa6ea017771df7de2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343027:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca57715f/0xa6ea017771df7de2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343043:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca57715f/0xa6ea017771df7de2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343061:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789351324.343065:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df7de9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343084:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8000 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351324.343087:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df7de9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343095:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df7de9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343106:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df7de9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343113:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df7de9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343128:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789351324.343131:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df7df0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343138:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351324.343147:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df7df0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343156:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df7df0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343166:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df7df0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343173:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df7df0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343187:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789351324.343191:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bf80d25/0xa6ea017771df7df7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343198:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351324.343202:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf80d25/0xa6ea017771df7df7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343208:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf80d25/0xa6ea017771df7df7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343218:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bf80d25/0xa6ea017771df7df7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343225:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bf80d25/0xa6ea017771df7df7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343245:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789351324.343248:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eb88e08/0xa6ea017771df7dfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343523:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030600 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351324.343527:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eb88e08/0xa6ea017771df7dfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343535:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eb88e08/0xa6ea017771df7dfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343546:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eb88e08/0xa6ea017771df7dfe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343552:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eb88e08/0xa6ea017771df7dfe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343567:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1789351324.343567:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789351324.343573:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd1ea51f/0xa6ea017771df7e05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.343577:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e2fbc3f/0xa6ea017771df7e0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343584:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031a00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351324.343590:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd1ea51f/0xa6ea017771df7e05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343610:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd1ea51f/0xa6ea017771df7e05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343620:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd1ea51f/0xa6ea017771df7e05 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343628:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd1ea51f/0xa6ea017771df7e05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351324.343641:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351324.343643:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351324.343645:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351324.343879:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.343886:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.343891:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e2fbc3f/0xa6ea017771df7e0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.343902:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e2fbc3f/0xa6ea017771df7e0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.343910:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e2fbc3f/0xa6ea017771df7e0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.343919:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e2fbc3f/0xa6ea017771df7e0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.343936:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789351324.343946:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789351324.343950:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e2fbc3f/0xa6ea017771df7e0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.343957:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031600 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351324.343966:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e2fbc3f/0xa6ea017771df7e0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.343975:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e2fbc3f/0xa6ea017771df7e0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.343986:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e2fbc3f/0xa6ea017771df7e0c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.343993:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e2fbc3f/0xa6ea017771df7e0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.344010:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351324.344013:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351324.344016:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789351324.344891:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.344897:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091c7de22/0xa6ea017771df7e13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.344907:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.344910:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.344915:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091c7de22/0xa6ea017771df7e13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.344924:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091c7de22/0xa6ea017771df7e13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.344932:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091c7de22/0xa6ea017771df7e13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.344944:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091c7de22/0xa6ea017771df7e13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.344963:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789351324.344987:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351324.344994:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091c7de22/0xa6ea017771df7e13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.345003:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031400 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351324.345007:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091c7de22/0xa6ea017771df7e13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.345016:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091c7de22/0xa6ea017771df7e13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.345032:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091c7de22/0xa6ea017771df7e13 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.345040:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091c7de22/0xa6ea017771df7e13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.345058:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.345060:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.345064:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789351324.345406:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.345413:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7e1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.345422:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.345426:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.345430:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7e1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.345439:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7e1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.345448:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7e1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.345456:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7e1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.345467:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789351324.345472:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789351324.345474:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7e1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.345481:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.345483:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030800 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351324.345494:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7e1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.345502:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7e1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.345514:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7e1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.345521:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081ca3a3b/0xa6ea017771df7e1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.345542:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.345545:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.345548:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789351324.345904:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.345916:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df7e21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.345924:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.345927:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.345931:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df7e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.345941:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df7e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.345949:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df7e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.345956:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df7e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.345973:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789351324.345995:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351324.346001:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df7e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.346009:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031200 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351324.346012:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df7e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.346021:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df7e21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.346034:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df7e21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.346049:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005603bb32/0xa6ea017771df7e21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.346083:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.346085:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.346087:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789351324.346445:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.346450:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6f5847d/0xa6ea017771df7e28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.346459:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.346462:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.346466:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6f5847d/0xa6ea017771df7e28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.346475:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6f5847d/0xa6ea017771df7e28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.346491:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6f5847d/0xa6ea017771df7e28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.346498:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6f5847d/0xa6ea017771df7e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.346512:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789351324.346519:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789351324.346523:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6f5847d/0xa6ea017771df7e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.346530:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0031c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351324.346534:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6f5847d/0xa6ea017771df7e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.346542:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6f5847d/0xa6ea017771df7e28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.346552:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6f5847d/0xa6ea017771df7e28 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.346560:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6f5847d/0xa6ea017771df7e28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.346573:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351324.346580:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351324.346582:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789351324.347031:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.347037:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed5c54d3/0xa6ea017771df7e2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.347045:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.347048:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.347052:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5c54d3/0xa6ea017771df7e2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.347061:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed5c54d3/0xa6ea017771df7e2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.347111:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed5c54d3/0xa6ea017771df7e2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.347119:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5c54d3/0xa6ea017771df7e2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.347142:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789351324.347569:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351324.347576:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed5c54d3/0xa6ea017771df7e2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.347584:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc0030e00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351324.347588:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed5c54d3/0xa6ea017771df7e2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.347661:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed5c54d3/0xa6ea017771df7e2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.347676:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed5c54d3/0xa6ea017771df7e2f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.347683:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed5c54d3/0xa6ea017771df7e2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.347699:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.347700:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.347702:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789351324.348043:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.348049:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003596a122/0xa6ea017771df7e36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.348058:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.348061:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.348066:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003596a122/0xa6ea017771df7e36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.348095:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003596a122/0xa6ea017771df7e36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.348104:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003596a122/0xa6ea017771df7e36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.348112:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003596a122/0xa6ea017771df7e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.348169:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789351324.348607:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.348614:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df7e3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.348623:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.348626:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.348630:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df7e3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.348639:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df7e3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.348647:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df7e3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.348666:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df7e3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.348837:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789351324.348843:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003596a122/0xa6ea017771df7e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.348851:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02045000 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351324.348855:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003596a122/0xa6ea017771df7e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.348862:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003596a122/0xa6ea017771df7e36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.348875:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003596a122/0xa6ea017771df7e36 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.348883:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003596a122/0xa6ea017771df7e36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.349032:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351324.349037:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df7e3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.349044:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02045c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351324.349047:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df7e3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.349055:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df7e3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.349091:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df7e3d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.349100:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.349102:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.349104:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351324.349786:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789351324.349793:0:14965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df7e3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789351324.350484:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.350492:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000741a947/0xa6ea017771df7e44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.350503:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.350507:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.350512:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000741a947/0xa6ea017771df7e44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.350524:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000741a947/0xa6ea017771df7e44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.350533:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000741a947/0xa6ea017771df7e44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.350541:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000741a947/0xa6ea017771df7e44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.350659:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351324.350666:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000741a947/0xa6ea017771df7e44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.350674:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02044c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351324.350677:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000741a947/0xa6ea017771df7e44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.350686:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000741a947/0xa6ea017771df7e44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.350698:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000741a947/0xa6ea017771df7e44 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.350706:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.350708:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.350709:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351324.350795:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789351324.350801:0:14965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000741a947/0xa6ea017771df7e44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.351404:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789351324.352012:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.352019:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9e2b0c9/0xa6ea017771df7e4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.352030:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.352034:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.352039:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9e2b0c9/0xa6ea017771df7e4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.352049:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9e2b0c9/0xa6ea017771df7e4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.352058:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9e2b0c9/0xa6ea017771df7e4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.352066:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9e2b0c9/0xa6ea017771df7e4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.352141:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789351324.352592:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.352612:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062b2defe/0xa6ea017771df7e52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.352627:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.352630:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.352635:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062b2defe/0xa6ea017771df7e52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.352644:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062b2defe/0xa6ea017771df7e52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.352652:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062b2defe/0xa6ea017771df7e52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.352659:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062b2defe/0xa6ea017771df7e52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.352816:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789351324.352824:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9e2b0c9/0xa6ea017771df7e4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.352839:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02044000 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351324.352843:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9e2b0c9/0xa6ea017771df7e4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.352853:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9e2b0c9/0xa6ea017771df7e4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.352868:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9e2b0c9/0xa6ea017771df7e4b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.352876:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9e2b0c9/0xa6ea017771df7e4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.352894:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351324.352898:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062b2defe/0xa6ea017771df7e52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.352905:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02044200 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351324.352908:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062b2defe/0xa6ea017771df7e52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.352915:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062b2defe/0xa6ea017771df7e52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.352926:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062b2defe/0xa6ea017771df7e52 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.352940:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.352942:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.352945:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351324.353239:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789351324.353245:0:14965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062b2defe/0xa6ea017771df7e52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789351324.353830:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.353837:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8c80d75/0xa6ea017771df7e59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.353846:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.353850:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.353855:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8c80d75/0xa6ea017771df7e59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.353877:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8c80d75/0xa6ea017771df7e59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.353887:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8c80d75/0xa6ea017771df7e59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.353895:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8c80d75/0xa6ea017771df7e59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.353941:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351324.353947:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8c80d75/0xa6ea017771df7e59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.353955:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02045a00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351324.353959:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8c80d75/0xa6ea017771df7e59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.353967:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8c80d75/0xa6ea017771df7e59 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.353979:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8c80d75/0xa6ea017771df7e59 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.354008:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.354010:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.354012:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351324.354085:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789351324.354091:0:14965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8c80d75/0xa6ea017771df7e59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.354467:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789351324.354936:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.354942:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009176cf90/0xa6ea017771df7e60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.354952:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.354954:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.354959:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009176cf90/0xa6ea017771df7e60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.354968:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009176cf90/0xa6ea017771df7e60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.354986:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009176cf90/0xa6ea017771df7e60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.354993:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009176cf90/0xa6ea017771df7e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.355046:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789351324.355566:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.355572:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5f247f0/0xa6ea017771df7e67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.355581:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.355585:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.355589:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f247f0/0xa6ea017771df7e67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.355671:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5f247f0/0xa6ea017771df7e67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.355679:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5f247f0/0xa6ea017771df7e67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.355687:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f247f0/0xa6ea017771df7e67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.355746:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789351324.355753:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009176cf90/0xa6ea017771df7e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.355761:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02044400 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351324.355771:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009176cf90/0xa6ea017771df7e60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.355780:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009176cf90/0xa6ea017771df7e60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.355794:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009176cf90/0xa6ea017771df7e60 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.355803:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009176cf90/0xa6ea017771df7e60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.355823:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351324.355827:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5f247f0/0xa6ea017771df7e67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.355835:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02045e00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351324.355839:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f247f0/0xa6ea017771df7e67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.355848:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f247f0/0xa6ea017771df7e67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.355861:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5f247f0/0xa6ea017771df7e67 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.355869:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.355877:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.355879:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351324.355951:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789351324.355956:0:14965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5f247f0/0xa6ea017771df7e67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789351324.356578:0:14965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789351324.356585:0:14965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df7e6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.356665:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789351324.356670:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351324.356675:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df7e6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.356686:0:14965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df7e6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.356694:0:14965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df7e6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351324.356702:0:14965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df7e6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.356748:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351324.356755:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df7e6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.356763:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02045800 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351324.356767:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df7e6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.356776:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df7e6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.356789:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df7e6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351324.356798:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.356800:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351324.356804:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351324.356874:0:14965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789351324.356879:0:14965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df7e6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789351324.357183:0:14965:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1789351324.357282:0:14965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14306:x1876270626451200:12345-0@lo:5:osp-pre-0-0.0 Request processed in 32055us (32862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351324.357291:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789351324.357449:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789351324.357488:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14306:1876270626451200:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789351324.357505:0:14306:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1789351324.357548:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14306:1876270626451328:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789351324.357587:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351324.357732:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc5e2fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789351324.357771:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626451328 00000100:00100000:0.0:1789351324.357778:0:14967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626451328 00000100:00100000:0.0:1789351324.357850:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789351324.357860:0:14967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14306:x1876270626451328:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789351324.357894:0:14967:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1789351324.367165:0:14967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14306:x1876270626451328:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9299us (9570us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789351324.367182:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789351324.367687:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14306:1876270626451328:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789351324.367718:0:14306:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:0.0:1789351324.372006:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789351324.898005:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789351325.089512:0:14280:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789351325.089519:0:14280:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d2cffaea000 from 7 10000000:01000000:1.0:1789351325.089523:0:14280:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789351325.089568:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4400/0xa6ea017771df7e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351325.089579:0:14280:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4400/0xa6ea017771df7e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351325.089591:0:14280:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4400/0xa6ea017771df7e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351325.089615:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626451456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789351325.089690:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351325.089743:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cda283180 going to sleep for 11 seconds 00000100:00100000:2.0:1789351325.090760:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626451456 00000100:00100000:2.0:1789351325.090770:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626451456 00000100:00100000:2.0:1789351325.090830:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789351325.090840:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+15:14280:x1876270626451456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789351325.090855:0:14278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351325.090870:0:14278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d00bc0e00/0xa6ea017771df7e7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7e75 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351325.090894:0:14278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d00bc0e00/0xa6ea017771df7e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7e75 expref: 16 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351325.090905:0:14278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d00bc0e00/0xa6ea017771df7e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7e75 expref: 16 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351325.090914:0:14278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0e00, rc 0) 00000100:00100000:2.0:1789351325.090969:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:14280:x1876270626451456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351325.090975:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789351325.091021:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb66d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626451456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789351325.091035:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4400/0xa6ea017771df7e75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7e7c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351325.091043:0:14280:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4400/0xa6ea017771df7e75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7e7c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351325.091110:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626451584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789351325.091148:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351325.091165:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc5e2f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789351325.091211:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626451584 00000100:00100000:1.0:1789351325.091215:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626451584 00000100:00100000:1.0:1789351325.091243:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789351325.091250:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:14280:x1876270626451584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789351325.091263:0:14277:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789351325.091278:0:14277:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789351325.091281:0:14277:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789351325.091350:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:14280:x1876270626451584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351325.091380:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789351325.091536:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626451584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789351325.091597:0:14280:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789351325.091604:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4400/0xa6ea017771df7e75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7e7c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351325.091613:0:14280:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4400/0xa6ea017771df7e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7e7c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351325.921576:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789351326.177720:0:14315:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789351326.177735:0:14315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789351326.178265:0:14315:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789351326.178334:0:14315:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789351326.178392:0:14315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:2.0:1789351326.947166:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789351327.164493:0:15330:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789351327.971471:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789351328.469637:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789351328.469694:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789351328.993536:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789351329.442216:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789351329.442222:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789351329.442225:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2cc308b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789351329.442231:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 268 00000100:00080000:2.0:1789351329.442237:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789351329.442242:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2cc308b000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789351329.442259:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2cffadb800 x1876270626451968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789351329.442324:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3286:1876270626451712:0@lo:400:kworker.0 00000100:00100000:0.0:1789351329.442415:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351329.442471:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789351329.442477:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626451840:0@lo:400:kworker.0 00000100:00100000:0.0:1789351329.442505:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351329.442540:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626451968:0@lo:8:kworker.0 00000100:00100000:0.0:1789351329.442562:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351329.442601:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876270626452096:0@lo:400:kworker.0 00000100:00100000:0.0:1789351329.442632:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351329.442652:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789351329.442659:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626452224:0@lo:400:kworker.0 00000100:00100000:0.0:1789351329.442681:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351329.442705:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626451840 00000100:00100000:0.0:1789351329.442712:0:14965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626451840 00000100:00100000:0.0:1789351329.442761:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626451968 00000100:00100000:0.0:1789351329.442764:0:14965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626451968 00000100:00100000:0.0:1789351329.442779:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351329.442789:0:14965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626451840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351329.442839:0:14965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626451840:12345-0@lo:400:kworker.0 Request processed in 52us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351329.442845:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351329.442859:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789351329.442863:0:14965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1876270626451968:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789351329.442879:0:14965:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789351329.443225:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626452096 00000100:00100000:3.0:1789351329.443231:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626452096 00000100:00100000:3.0:1789351329.443254:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626452224 00000100:00100000:3.0:1789351329.443256:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626452224 00000100:00100000:3.0:1789351329.443271:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789351329.443279:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876270626452096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351329.443328:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876270626452096:12345-0@lo:400:kworker.0 Request processed in 50us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351329.443335:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789351329.443382:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789351329.443622:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626452224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351329.443672:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626452224:12345-0@lo:400:kworker.0 Request processed in 283us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351329.443680:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789351329.443771:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2cffad8a80 x1876270626452224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351329.443781:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626452224:0@lo:400:kworker.0 00010000:00080000:1.0:1789351329.443789:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2cffada300 x1876270626452096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351329.443795:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876270626452096:0@lo:400:kworker.0 00000100:00100000:1.0:1789351329.443813:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789351329.443819:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626452352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789351329.443842:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351329.443863:0:14968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626452352 00000100:00100000:1.0:1789351329.443866:0:14968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626452352 00000100:00100000:1.0:1789351329.443884:0:14968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789351329.443893:0:14968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626452352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789351329.443914:0:14968:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789351329.443938:0:14968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626452352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351329.443942:0:14968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789351329.443962:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789351329.443977:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626452352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789351329.444024:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626451840:0@lo:400:kworker.0 00000100:00100000:2.0:1789351329.444103:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626451712 00000100:00100000:2.0:1789351329.444107:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626451712 00000100:00100000:2.0:1789351329.444131:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789351329.444135:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:3286:x1876270626451712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351329.444170:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:3286:x1876270626451712:12345-0@lo:400:kworker.0 Request processed in 34us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351329.444183:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1789351329.444215:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789351329.444220:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789351329.444572:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3286:1876270626451712:0@lo:400:kworker.0 00000100:00100000:0.0:1789351329.464166:0:14965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1876270626451968:12345-0@lo:8:kworker.0 Request processed in 21296us (21596us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789351329.464179:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789351329.464293:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2cc308b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789351329.464300:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789351329.464304:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626451968:0@lo:8:kworker.0 00010000:00010000:2.0:1789351330.017664:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351331.043014:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789351331.683604:0:15681:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789351331.683609:0:15681:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789351331.683737:0:15681:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8d2bc3740000 00000020:01000004:3.0:1789351331.683756:0:15681:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789351331.683771:0:15681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789351331.683807:0:15681:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d2bc3798000) 00000020:00000080:3.0:1789351331.683827:0:15681:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789351331.696945:0:15681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789351331.697171:0:15681:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789351331.697937:0:15681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789351331.698191:0:15681:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789351331.698544:0:15681:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789351331.698905:0:15681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:3.0:1789351331.699069:0:15681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:3.0:1789351331.699148:0:15681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 403: rc = 0 00100000:10000000:2.0:1789351331.699792:0:15681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:2.0:1789351331.700048:0:15681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1789351331.700502:0:15681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1789351331.700697:0:15681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:2.0:1789351331.700967:0:15681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1789351331.701203:0:15681:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00000020:00000080:2.0:1789351331.701855:0:15681:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789351331.701871:0:15681:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789351331.701886:0:15681:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa6ea017771df7e8a 00000020:01000004:2.0:1789351331.701897:0:15681:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789351331.701924:0:15681:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789351331.701928:0:15681:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789351331.701934:0:15681:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789351331.701973:0:15681:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789351331.701978:0:15681:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789351331.710095:0:15681:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.152@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789351331.710143:0:15681:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.152@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789351331.710148:0:15681:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789351331.710150:0:15681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789351331.710151:0:15681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789351331.710153:0:15681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789351331.710154:0:15681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789351331.710155:0:15681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789351331.710157:0:15681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789351331.710158:0:15681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789351331.710163:0:15681:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789351331.710168:0:15681:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789351331.710170:0:15681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789351331.710172:0:15681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789351331.710173:0:15681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789351331.710173:0:15681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789351331.710174:0:15681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789351331.710175:0:15681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789351331.710176:0:15681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789351331.710177:0:15681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789351331.710178:0:15681:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789351331.710210:0:15681:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789351331.710241:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626452480:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789351331.710347:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351331.710632:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd98fb000 going to sleep for 11 seconds 00000100:00100000:0.0:1789351331.710737:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626452480 00000100:00100000:0.0:1789351331.710747:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626452480 00000100:00100000:0.0:1789351331.710839:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789351331.710851:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:15681:x1876270626452480:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789351331.710887:0:14278:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789351331.710890:0:14278:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789351331.710901:0:14278:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789351331.717174:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:15681:x1876270626452480:12345-0@lo:253:mount.lustre.0 Request processed in 6311us (6813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351331.717200:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789351331.717334:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626452480:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789351331.717355:0:15681:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789351331.717414:0:15681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789351331.717416:0:15681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789351331.717418:0:15681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789351331.717419:0:15681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789351331.717420:0:15681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789351331.717422:0:15681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789351331.717424:0:15681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789351331.717426:0:15681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789351331.717428:0:15681:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789351331.717458:0:15681:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2bc3740000 from lustre-OST0001 10000000:01000000:0.0:1789351331.717492:0:15681:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789351331.717495:0:15681:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789351331.717504:0:15681:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2ce9decd40 local copy 00010000:00010000:0.0:1789351331.717519:0:15681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104600/0xa6ea017771df7c30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7c37 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351331.717796:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626452608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789351331.717843:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351331.717930:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52300 going to sleep for 11 seconds 00000100:00100000:1.0:1789351331.717983:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626452608 00000100:00100000:1.0:1789351331.717991:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626452608 00000100:00100000:1.0:1789351331.718078:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789351331.718091:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:15681:x1876270626452608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789351331.718405:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:15681:x1876270626452608:12345-0@lo:501:mount.lustre.0 Request processed in 316us (561us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789351331.718413:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789351331.718488:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626452608:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789351331.718505:0:15681:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789351331.718651:0:15681:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789351331.718660:0:15681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104600/0xa6ea017771df7c30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7c37 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351331.718670:0:15681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cc3104600/0xa6ea017771df7c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7c37 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789351331.718711:0:15681:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2bc3740000 10000000:01000000:0.0:1789351331.718717:0:15681:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789351331.718724:0:15681:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789351331.718726:0:15681:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789351331.718731:0:15681:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789351331.718733:0:15681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789351331.718762:0:15681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d02044000/0xa6ea017771df7e91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351331.718770:0:15681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d02044000/0xa6ea017771df7e91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351331.718781:0:15681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d02044000/0xa6ea017771df7e91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351331.718797:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626452736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789351331.718821:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351331.718929:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52300 going to sleep for 11 seconds 00000100:00100000:2.0:1789351331.719005:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626452736 00000100:00100000:2.0:1789351331.719011:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626452736 00000100:00100000:2.0:1789351331.719043:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789351331.719052:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:15681:x1876270626452736:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789351331.719063:0:14277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351331.719078:0:14277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d00bc0000/0xa6ea017771df7e98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7e91 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351331.719104:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d00bc0000/0xa6ea017771df7e98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7e91 expref: 17 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351331.719113:0:14277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d00bc0000/0xa6ea017771df7e98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7e91 expref: 17 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351331.719121:0:14277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0000, rc 0) 00000100:00100000:2.0:1789351331.719158:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:15681:x1876270626452736:12345-0@lo:101:mount.lustre.0 Request processed in 107us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351331.719165:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789351331.719185:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626452736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789351331.719271:0:15681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d02044000/0xa6ea017771df7e91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7e98 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351331.719282:0:15681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d02044000/0xa6ea017771df7e91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7e98 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789351331.719815:0:15681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789351331.720638:0:15681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789351331.720870:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789351331.720908:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789351331.720933:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789351331.720990:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789351331.721019:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789351331.721055:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789351331.721095:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789351331.721100:0:15681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789351331.721169:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626452864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789351331.721403:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351331.721454:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789351331.721516:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626452864 00000100:00100000:3.0:1789351331.721525:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626452864 00000100:00100000:3.0:1789351331.721583:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789351331.721593:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:15681:x1876270626452864:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789351331.722016:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:15681:x1876270626452864:12345-0@lo:501:mount.lustre.0 Request processed in 424us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351331.722025:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789351331.722110:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626452864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789351331.722150:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626452992:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789351331.722255:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351331.722320:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789351331.722449:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626452992 00000100:00100000:1.0:1789351331.722456:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626452992 00000100:00100000:0.0:1789351331.722637:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789351331.722647:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:15681:x1876270626452992:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789351331.722992:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:15681:x1876270626452992:12345-0@lo:503:mount.lustre.0 Request processed in 347us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351331.723000:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789351331.723084:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626452992:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789351331.723926:0:15681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789351331.724026:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626453120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789351331.724091:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351331.724459:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941240 going to sleep for 11 seconds 00000100:00100000:2.0:1789351331.724566:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626453120 00000100:00100000:2.0:1789351331.724574:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626453120 00000100:00100000:2.0:1789351331.724615:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789351331.724626:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:15681:x1876270626453120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789351331.724843:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:15681:x1876270626453120:12345-0@lo:502:mount.lustre.0 Request processed in 219us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351331.724848:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789351331.724921:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626453120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789351331.725151:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789351331.725521:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789351331.725565:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789351331.725635:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789351331.725682:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789351331.725708:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789351331.725736:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789351331.725753:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789351331.725776:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789351331.725808:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626453248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789351331.725851:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351331.725882:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941240 going to sleep for 11 seconds 00000100:00100000:2.0:1789351331.725925:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626453248 00000100:00100000:2.0:1789351331.725930:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626453248 00000100:00100000:2.0:1789351331.725973:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789351331.725982:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:15681:x1876270626453248:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789351331.726120:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:15681:x1876270626453248:12345-0@lo:502:mount.lustre.0 Request processed in 139us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351331.726125:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789351331.726250:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626453248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789351331.726311:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789351331.726320:0:15681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1789351331.727665:0:15682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789351331.727677:0:15682:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789351331.727685:0:15682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789351331.727688:0:15682:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789351331.727695:0:15682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789351331.727713:0:15682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d2bc379b380) 00000020:00000080:3.0:1789351331.727745:0:15682:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789351331.727756:0:15682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789351331.727848:0:15682:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2bc3740000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789351331.727857:0:15682:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789351331.727865:0:15682:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa6ea017771df7ea6 00010000:00010000:3.0:1789351331.731113:0:15682:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1789351331.731685:0:15682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1789351331.733602:0:15682:0:(osd_index.c:2105:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789351331.735016:0:15682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789351331.735030:0:15682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789351331.735036:0:15682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789351331.735039:0:15682:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789351331.735041:0:15682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789351331.735045:0:15682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789351331.735046:0:15682:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789351331.735048:0:15682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789351331.735050:0:15682:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789351331.735051:0:15682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789351331.735060:0:15682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789351331.735062:0:15682:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789351331.735065:0:15682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789351331.735068:0:15682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789351331.735069:0:15682:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789351331.735073:0:15682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789351331.735134:0:15682:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789351331.735137:0:15682:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789351331.735138:0:15682:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789351331.735140:0:15682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789351331.736014:0:15681:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789351331.736078:0:15681:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789351331.736155:0:15681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d02044000/0xa6ea017771df7e91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7e98 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.736170:0:15681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d02044000/0xa6ea017771df7e91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7e98 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351331.736180:0:15681:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2bc3740000 from 1 10000000:01000000:1.0:1789351331.736184:0:15681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789351331.736254:0:15681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5800/0xa6ea017771df7ead lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.736273:0:15681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5800/0xa6ea017771df7ead lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.736287:0:15681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5800/0xa6ea017771df7ead lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351331.736319:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626453376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789351331.736426:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351331.736481:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941240 going to sleep for 11 seconds 00000100:00100000:0.0:1789351331.736990:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626453376 00000100:00100000:0.0:1789351331.737001:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626453376 00000100:00100000:0.0:1789351331.737059:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789351331.737069:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:15681:x1876270626453376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789351331.737094:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351331.737110:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d02045000/0xa6ea017771df7eb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7ead expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351331.737140:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d02045000/0xa6ea017771df7eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7ead expref: 18 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351331.737150:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d02045000/0xa6ea017771df7eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7ead expref: 18 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351331.737158:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d02045000, rc 0) 00000100:00100000:0.0:1789351331.737219:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:15681:x1876270626453376:12345-0@lo:101:mount.lustre.0 Request processed in 150us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351331.737227:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789351331.737324:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626453376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789351331.737341:0:15681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5800/0xa6ea017771df7ead lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7eb4 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.737349:0:15681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5800/0xa6ea017771df7ead lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7eb4 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789351331.738035:0:15681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789351331.738760:0:15681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789351331.739043:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789351331.739083:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789351331.739138:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789351331.739145:0:15681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789351331.739239:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626453504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789351331.739319:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351331.739397:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941240 going to sleep for 11 seconds 00000100:00100000:2.0:1789351331.739474:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626453504 00000100:00100000:2.0:1789351331.739483:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626453504 00000100:00100000:2.0:1789351331.739765:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789351331.739777:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:15681:x1876270626453504:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789351331.740053:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:15681:x1876270626453504:12345-0@lo:501:mount.lustre.0 Request processed in 279us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351331.740061:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789351331.740234:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626453504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789351331.740274:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626453632:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789351331.740324:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351331.740470:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941240 going to sleep for 11 seconds 00000100:00100000:0.0:1789351331.740509:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626453632 00000100:00100000:0.0:1789351331.740515:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626453632 00000100:00100000:0.0:1789351331.740580:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789351331.740593:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:15681:x1876270626453632:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789351331.740932:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:15681:x1876270626453632:12345-0@lo:503:mount.lustre.0 Request processed in 340us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351331.740940:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789351331.741026:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626453632:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789351331.741643:0:15681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789351331.741721:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626453760:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789351331.741769:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351331.741946:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941240 going to sleep for 11 seconds 00000100:00100000:3.0:1789351331.742001:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626453760 00000100:00100000:3.0:1789351331.742008:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626453760 00000100:00100000:3.0:1789351331.742039:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789351331.742048:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:15681:x1876270626453760:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789351331.742253:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:15681:x1876270626453760:12345-0@lo:502:mount.lustre.0 Request processed in 206us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351331.742261:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789351331.742348:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626453760:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789351331.742625:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789351331.742683:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789351331.742734:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789351331.742770:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789351331.742804:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789351331.742849:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789351331.742886:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789351331.742918:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789351331.742948:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626453888:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789351331.743009:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351331.743033:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941240 going to sleep for 11 seconds 00000100:00100000:3.0:1789351331.743122:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626453888 00000100:00100000:3.0:1789351331.743127:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626453888 00000100:00100000:3.0:1789351331.743150:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789351331.743157:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:15681:x1876270626453888:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789351331.743300:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:15681:x1876270626453888:12345-0@lo:502:mount.lustre.0 Request processed in 143us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351331.743307:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789351331.743429:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626453888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789351331.743506:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789351331.743516:0:15681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789351331.744664:0:15686:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789351331.744677:0:15686:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351331.744680:0:15686:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789351331.744687:0:15686:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2bc3740000 00000020:00000080:1.0:1789351331.744690:0:15686:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789351331.744706:0:15686:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789351331.744709:0:15686:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351331.744710:0:15686:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789351331.744713:0:15686:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789351331.744715:0:15686:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351331.744717:0:15686:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789351331.744720:0:15686:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2bc3740000 00000020:00000080:1.0:1789351331.744723:0:15686:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789351331.744794:0:15686:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789351331.747004:0:15686:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351331.747014:0:15686:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789351331.747026:0:15686:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789351331.747032:0:15686:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351331.747034:0:15686:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789351331.747040:0:15686:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2bc3740000 00000020:00000080:1.0:1789351331.747043:0:15686:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789351331.747514:0:15686:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789351331.747519:0:15686:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789351331.747521:0:15686:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789351331.747524:0:15686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789351331.747760:0:15681:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789351331.747796:0:15681:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789351331.747819:0:15681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5800/0xa6ea017771df7ead lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7eb4 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351331.747833:0:15681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5800/0xa6ea017771df7ead lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7eb4 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789351331.747894:0:15681:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789351331.747897:0:15681:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2bc3740000 10000000:01000000:3.0:1789351331.747902:0:15681:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2bc3740000 10000000:01000000:3.0:1789351331.747906:0:15681:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789351331.747913:0:15681:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d2bc3740000 from 1 10000000:01000000:3.0:1789351331.747915:0:15681:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789351331.747975:0:15681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc3105600/0xa6ea017771df7ebb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351331.747984:0:15681:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2cc3105600/0xa6ea017771df7ebb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351331.747998:0:15681:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2cc3105600/0xa6ea017771df7ebb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351331.748028:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626454016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789351331.748113:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351331.748171:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc60c2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789351331.748236:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626454016 00000100:00100000:0.0:1789351331.748245:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626454016 00000100:00100000:0.0:1789351331.748297:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789351331.748307:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:15681:x1876270626454016:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789351331.748325:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351331.748340:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d02044400/0xa6ea017771df7ec2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7ebb expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351331.748392:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d02044400/0xa6ea017771df7ec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7ebb expref: 19 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351331.748405:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d02044400/0xa6ea017771df7ec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7ebb expref: 19 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351331.748415:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d02044400, rc 0) 00000100:00100000:0.0:1789351331.748464:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:15681:x1876270626454016:12345-0@lo:101:mount.lustre.0 Request processed in 158us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351331.748470:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789351331.748593:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626454016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789351331.748610:0:15681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2cc3105600/0xa6ea017771df7ebb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7ec2 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351331.748619:0:15681:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2cc3105600/0xa6ea017771df7ebb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7ec2 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789351331.749305:0:15681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789351331.749803:0:15681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789351331.750055:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789351331.750092:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789351331.750118:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789351331.750153:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789351331.750180:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789351331.750218:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789351331.750249:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789351331.750278:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789351331.750333:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789351331.750391:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789351331.750421:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789351331.750459:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789351331.750487:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789351331.750515:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789351331.750561:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789351331.750591:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789351331.750616:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789351331.750652:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789351331.750679:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789351331.750705:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789351331.750741:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789351331.750768:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789351331.750794:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789351331.750829:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789351331.750871:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789351331.750897:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789351331.750962:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789351331.750996:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789351331.751021:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789351331.751070:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1789351331.751098:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1789351331.751124:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1789351331.751149:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1789351331.751185:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1789351331.751212:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1789351331.751248:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1789351331.751275:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1789351331.751349:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1789351331.751401:0:15681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789351331.751506:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626454144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789351331.751585:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351331.751628:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc60c2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789351331.751763:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626454144 00000100:00100000:0.0:1789351331.751771:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626454144 00000100:00100000:0.0:1789351331.751820:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789351331.751829:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:15681:x1876270626454144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789351331.752089:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:15681:x1876270626454144:12345-0@lo:501:mount.lustre.0 Request processed in 260us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351331.752105:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789351331.752237:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626454144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789351331.752269:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626454272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789351331.752306:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351331.752354:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc60c2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789351331.753503:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626454272 00000100:00100000:0.0:1789351331.753513:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626454272 00000100:00100000:0.0:1789351331.756061:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789351331.756084:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:15681:x1876270626454272:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789351331.756643:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:15681:x1876270626454272:12345-0@lo:503:mount.lustre.0 Request processed in 567us (4334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351331.756653:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789351331.758149:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626454272:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789351331.759736:0:15681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789351331.759870:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626454400:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789351331.759986:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351331.760057:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351331.763194:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626454400 00000100:00100000:3.0:1789351331.763216:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626454400 00000100:00100000:3.0:1789351331.763539:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789351331.763554:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:15681:x1876270626454400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789351331.764074:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:15681:x1876270626454400:12345-0@lo:502:mount.lustre.0 Request processed in 522us (4085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351331.764154:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626454400:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789351331.764520:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789351331.764585:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789351331.764623:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789351331.764690:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789351331.764731:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789351331.764794:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789351331.764833:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789351331.764865:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789351331.764914:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789351331.764960:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789351331.764999:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789351331.765063:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789351331.765099:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789351331.765148:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789351331.765202:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789351331.765240:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789351331.765276:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789351331.765325:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789351331.765396:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789351331.765435:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789351331.765484:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789351331.765517:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789351331.765545:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789351331.765586:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789351331.765620:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789351331.765654:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789351331.765701:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789351331.765755:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789351331.765791:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789351331.765840:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789351331.765876:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789351331.765910:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789351331.765944:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789351331.766012:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789351331.766049:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789351331.766098:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789351331.766136:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789351331.766172:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789351331.766222:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789351331.766259:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789351331.766324:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626454528:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789351331.766447:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351331.766520:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626454528 00000100:00100000:0.0:1789351331.766528:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626454528 00000100:00100000:0.0:1789351331.766581:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789351331.766598:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+20:15681:x1876270626454528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789351331.766843:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7356450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+20:15681:x1876270626454528:12345-0@lo:502:mount.lustre.0 Request processed in 246us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351331.766852:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789351331.766923:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351331.767025:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789351331.767104:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626454528:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789351331.767176:0:15681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789351331.767185:0:15681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789351331.771394:0:15690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789351331.771419:0:15690:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d2bc37999c0) 00000020:00000080:3.0:1789351331.771451:0:15690:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1789351331.771694:0:15690:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2bc3740000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789351331.771705:0:15690:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2bc3740000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789351331.771708:0:15690:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2bc3740000 3 00010000:00080000:3.0:1789351331.771752:0:15690:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2bc26d6800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.152@tcp at head 00010000:00010000:3.0:1789351331.773558:0:15690:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1789351331.773700:0:15690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789351331.773746:0:15690:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789351331.773762:0:15690:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa6ea017771df7ed0 00000100:00080000:3.0:1789351331.773776:0:15690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789351331.773782:0:15690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d2bc26d6800 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:3.0:1789351331.773828:0:15690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2ceec44a80 x1876270626454656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789351331.773871:0:15690:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789351331.773996:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1876270626454656:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789351331.774154:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789351331.776981:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789351331.776990:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789351331.776994:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d2cc308b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789351331.777005:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 273 00000100:00080000:1.0:1789351331.777013:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789351331.777021:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2cc308b000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:1.0:1789351331.777048:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2cffb64a80 x1876270626454912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789351331.777136:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626454656 00000100:00100000:1.0:1789351331.777145:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626454656 00000100:00100000:1.0:1789351331.777191:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789351331.777209:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1876270626454656:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789351331.777244:0:14285:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:1.0:1789351331.777527:0:14285:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa6ea017771df7ed7 00000004:00100000:1.0:1789351331.777550:0:14285:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789351331.777590:0:14285:0:(import.c:65:import_set_state_nolock()) ffff8d2cc31ad000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789351331.777697:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876270626454656:12345-0@lo:38:llog_process_th.0 Request processed in 487us (3542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351331.777706:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789351331.777738:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789351331.777755:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626454784:0@lo:400:kworker.0 00000100:00100000:1.0:1789351331.777806:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351331.777855:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626454912:0@lo:8:kworker.0 00000100:00100000:1.0:1789351331.777886:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789351331.777931:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2ceec44a80 x1876270626454656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789351341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351331.777944:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789351331.777967:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789351331.777977:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789351331.777982:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789351331.777986:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2bc26d6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789351331.777992:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1876270626454656:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789351331.778025:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876270626455040:0@lo:400:kworker.0 00000100:00100000:1.0:1789351331.778058:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351331.778081:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789351331.778087:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626455168:0@lo:400:kworker.0 00000100:00100000:1.0:1789351331.778121:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351331.778160:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626455040 00000100:00100000:1.0:1789351331.778165:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626455040 00000100:00100000:1.0:1789351331.778194:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626455168 00000100:00100000:1.0:1789351331.778198:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626455168 00000100:00100000:1.0:1789351331.778229:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789351331.778237:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789351331.778238:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876270626455040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351331.778290:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876270626455040:12345-0@lo:400:kworker.0 Request processed in 53us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351331.778297:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789351331.778310:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789351331.778316:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626455168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351331.778345:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876270626455168:12345-0@lo:400:kworker.0 Request processed in 29us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351331.778351:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789351331.778408:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626454784 00000100:00100000:1.0:1789351331.778412:0:14967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626454784 00000100:00100000:1.0:1789351331.778443:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626454912 00000100:00100000:1.0:1789351331.778446:0:14967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626454912 00000100:00100000:1.0:1789351331.778457:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789351331.778463:0:14967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626454784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789351331.778500:0:14967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626454784:12345-0@lo:400:kworker.0 Request processed in 38us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351331.778507:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789351331.778519:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789351331.778523:0:14967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3285:x1876270626454912:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789351331.778565:0:14967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3285:x1876270626454912:12345-0@lo:8:kworker.0 Request processed in 40us (679us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789351331.778577:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789351331.778619:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626454784:0@lo:400:kworker.0 00010000:00080000:2.0:1789351331.778632:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2cffb66a00 x1876270626455168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789351331.778645:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876270626455168:0@lo:400:kworker.0 00000100:00100000:1.0:1789351331.778648:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789351331.778654:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2cc308b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789351331.778659:0:3285:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789351331.778662:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626454912:0@lo:8:kworker.0 00010000:00080000:2.0:1789351331.778670:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2cffb64700 x1876270626455040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789351347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789351331.778679:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789351331.778681:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876270626455040:0@lo:400:kworker.0 00000040:00080000:3.0:1789351331.780107:0:15690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1789351331.780251:0:15681:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789351331.780303:0:15681:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789351331.780329:0:15681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2cc3105600/0xa6ea017771df7ebb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7ec2 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351331.780341:0:15681:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2cc3105600/0xa6ea017771df7ebb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7ec2 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789351331.780420:0:15681:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789351331.780423:0:15681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789351331.780425:0:15681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789351331.780426:0:15681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789351331.780428:0:15681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789351331.780429:0:15681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789351331.780431:0:15681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789351331.780433:0:15681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789351331.780435:0:15681:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789351331.780440:0:15681:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789351331.780442:0:15681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789351331.780444:0:15681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789351331.780445:0:15681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789351331.780446:0:15681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789351331.780447:0:15681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789351331.780448:0:15681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789351331.780454:0:15681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789351331.780455:0:15681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789351331.780456:0:15681:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789351331.780487:0:15681:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789351331.780508:0:15681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626455296:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789351331.780588:0:15681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351331.780630:0:15681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6c52300 going to sleep for 11 seconds 00000100:00100000:0.0:1789351331.780657:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626455296 00000100:00100000:0.0:1789351331.780665:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626455296 00000100:00100000:0.0:1789351331.780710:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789351331.780719:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:15681:x1876270626455296:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789351331.780751:0:14275:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789351331.780769:0:14275:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789351331.803181:0:14275:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789351331.803201:0:14275:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789351331.803218:0:14299:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789351331.803230:0:14299:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789351331.803260:0:14299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2d00bc1200/0xa6ea017771df7ede lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351331.803284:0:14299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d00bc0e00/0xa6ea017771df7e7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7e75 expref: 19 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351331.803294:0:14299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2d00bc1200/0xa6ea017771df7ede lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351331.803345:0:14299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d00bc0e00/0xa6ea017771df7e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df7e75 expref: 19 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351331.803395:0:14299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2d00bc0e00/0xa6ea017771df7e7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df7e75 expref: 19 pid: 14278 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351331.803414:0:14299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadaa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14299:1876270626455424:0@lo:104: 00000100:00100000:2.0:1789351331.803513:0:14299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351331.803578:0:14299:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789351331.803605:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626455424 00000100:00100000:0.0:1789351331.803614:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626455424 00000100:00100000:0.0:1789351331.803669:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789351331.803682:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+3:14299:x1876270626455424:12345-0@lo:104: 00010000:00010000:0.0:1789351331.803703:0:14267:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4400/0xa6ea017771df7e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df7e7c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351331.803781:0:14267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789351331.803789:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+3:14299:x1876270626455424:12345-0@lo:104: Request processed in 110us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351331.803800:0:14299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadaa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14299:1876270626455424:0@lo:104: 00000100:00100000:0.0:1789351331.803800:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789351331.803826:0:14299:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2d00bc1200/0xa6ea017771df7ede lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351331.803914:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351331.803923:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4400/0xa6ea017771df7e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df7e7c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351331.803939:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4400 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:2.0:1789351331.803943:0:14271:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4400/0xa6ea017771df7e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df7e7c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351331.803965:0:14271:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4400/0xa6ea017771df7e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df7e7c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789351331.803973:0:14271:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4400/0xa6ea017771df7e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df7e7c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351331.803979:0:14271:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789351331.804031:0:14271:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4400/0xa6ea017771df7e75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7e7c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351331.804039:0:14271:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789351331.804065:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4400/0xa6ea017771df7e75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7e7c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351331.804083:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789351331.804098:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3287:1876270626455552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789351331.804126:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351331.804178:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626455552 00000100:00100000:1.0:1789351331.804195:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626455552 00010000:00010000:1.0:1789351331.804217:0:14268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d00bc0e00/0xa6ea017771df7e7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df7e75 expref: 20 pid: 14278 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351331.804257:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789351331.804266:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+20:3287:x1876270626455552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351331.804278:0:14268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351331.804284:0:14268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d00bc0e00/0xa6ea017771df7e7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df7e75 expref: 20 pid: 14278 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.804296:0:14268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d00bc0e00/0xa6ea017771df7e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df7e75 expref: 20 pid: 14278 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.804311:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d00bc0e00/0xa6ea017771df7e7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df7e75 expref: 20 pid: 14278 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.804353:0:14268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2d00bc1200/0xa6ea017771df7ede lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.804396:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d00bc1200/0xa6ea017771df7ede lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789351331.804409:0:14268:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002740836s 00010000:00010000:1.0:1789351331.804414:0:14268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2d00bc1200/0xa6ea017771df7ede lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.804422:0:14268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2d00bc1200/0xa6ea017771df7ede lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.804430:0:14268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2d00bc1200/0xa6ea017771df7ede lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.804437:0:14268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2d00bc1200/0xa6ea017771df7ede lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.804444:0:14268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1200 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351331.804449:0:14268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2d00bc1200/0xa6ea017771df7ede lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.804458:0:14268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2d00bc1200/0xa6ea017771df7ede lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351331.804474:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc4400/0xa6ea017771df7e75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7e7c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.804475:0:14268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2d00bc1200/0xa6ea017771df7ede lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.804496:0:14268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351331.804502:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351331.804506:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351331.804509:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351331.804541:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:3287:x1876270626455552:12345-0@lo:103:ldlm_bl.0 Request processed in 276us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351331.804549:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789351331.804571:0:14299:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2d00bc1200/0xa6ea017771df7ede lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.804579:0:14299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2d00bc1200/0xa6ea017771df7ede lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351331.804586:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d00bc1200/0xa6ea017771df7ede lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351331.804943:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3287:1876270626455552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789351331.809897:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:15681:x1876270626455296:12345-0@lo:253:mount.lustre.0 Request processed in 29167us (29296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351331.809912:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789351331.810124:0:15681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:15681:1876270626455296:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789351331.810144:0:15681:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789351331.810149:0:15681:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789351331.810151:0:15681:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789351331.810152:0:15681:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789351331.810153:0:15681:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789351331.810154:0:15681:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789351331.810156:0:15681:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789351331.810158:0:15681:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789351331.810160:0:15681:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789351331.810161:0:15681:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789351331.810179:0:15681:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789351331.815565:0:15681:0:(osd_index.c:2105:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789351331.815709:0:15681:0:(osd_index.c:2105:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789351331.815886:0:15681:0:(osd_index.c:2105:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789351331.816036:0:15681:0:(osd_index.c:2105:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789351331.816179:0:15681:0:(osd_index.c:2105:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789351331.816403:0:15681:0:(osd_index.c:2105:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789351331.817875:0:15681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789351331.849161:0:15681:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789351331.849176:0:15681:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789351331.849229:0:15681:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789351331.849334:0:15681:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789351331.849398:0:15681:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789351331.849434:0:15681:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1789351332.065542:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351333.090466:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789351333.283566:0:14280:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789351333.283581:0:14280:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d2cffaea000 from 8 10000000:01000000:2.0:1789351333.283589:0:14280:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789351333.283655:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0400/0xa6ea017771df7ee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351333.283684:0:14280:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0400/0xa6ea017771df7ee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351333.283701:0:14280:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0400/0xa6ea017771df7ee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351333.283737:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626455680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789351333.283833:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351333.283901:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626455680 00000100:00100000:2.0:1789351333.283902:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351333.283912:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626455680 00000100:00100000:1.0:1789351333.284005:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789351333.284019:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:14280:x1876270626455680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789351333.284045:0:14278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351333.284062:0:14278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecc5c00/0xa6ea017771df7eec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df7ee5 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351333.284096:0:14278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecc5c00/0xa6ea017771df7eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df7ee5 expref: 19 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351333.284110:0:14278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecc5c00/0xa6ea017771df7eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7ee5 expref: 19 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351333.284121:0:14278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5c00, rc 0) 00000100:00100000:1.0:1789351333.284185:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7355450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:14280:x1876270626455680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351333.284192:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789351333.284199:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626455680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789351333.284215:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0400/0xa6ea017771df7ee5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7eec expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351333.284225:0:14280:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0400/0xa6ea017771df7ee5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df7eec expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351333.284277:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626455808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789351333.284309:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351333.284330:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351333.284571:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626455808 00000100:00100000:1.0:1789351333.284575:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626455808 00000100:00100000:1.0:1789351333.284601:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789351333.284610:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:14280:x1876270626455808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789351333.284625:0:14275:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789351333.284644:0:14275:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789351333.284647:0:14275:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789351333.284735:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7354050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:14280:x1876270626455808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351333.284743:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789351333.284745:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626455808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789351333.284831:0:14280:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789351333.284839:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0400/0xa6ea017771df7ee5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7eec expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351333.284846:0:14280:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0400/0xa6ea017771df7ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df7eec expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351334.113594:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789351334.561662:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626455936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789351334.561742:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351334.562429:0:14968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626455936 00000100:00100000:1.0:1789351334.562437:0:14968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626455936 00000100:00100000:1.0:1789351334.562503:0:14968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789351334.562516:0:14968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626455936:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789351334.562643:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789351334.562661:0:14968:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789351334.562729:0:14968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626455936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 217us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351334.562734:0:14968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789351334.562865:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626455936:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789351335.137765:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789351335.264203:0:16034:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789351336.162709:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789351336.420038:0:14315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789351336.500869:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351336.500966:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617038208 00000100:00100000:1.0:1789351336.500980:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617038208 00000100:00100000:1.0:1789351336.501052:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:1.0:1789351336.501071:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2346:x1876270617038208:12345-192.168.201.52@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789351336.501110:0:14278:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 6427e0e9-9c75-48a8-96a8-7276ecdd0115@192.168.201.52@tcp t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:1.0:1789351336.501161:0:14278:0:(genops.c:1406:class_connect()) connect: client 6427e0e9-9c75-48a8-96a8-7276ecdd0115, cookie 0xa6ea017771df7ef3 00000100:00080000:1.0:1789351336.501341:0:14278:0:(import.c:65:import_set_state_nolock()) ffff8d2cd8421000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789351336.501469:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7357450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+5:2346:x1876270617038208:12345-192.168.201.52@tcp:250:mount.lustre.0 Request processed in 406us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351336.501489:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 71 00000100:00100000:2.0:1789351336.506751:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351336.506832:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617038336 00000100:00100000:1.0:1789351336.506847:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617038336 00000100:00100000:1.0:1789351336.506940:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:1.0:1789351336.506953:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+5:13724:x1876270617038336:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789351336.506976:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351336.507010:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecc5000/0xa6ea017771df7efa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8054 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351336.507049:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecc5000/0xa6ea017771df7efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8054 expref: 6 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351336.507064:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecc5000/0xa6ea017771df7efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8054 expref: 6 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351336.507092:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5000, rc 0) 00000100:00100000:1.0:1789351336.507162:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+6:13724:x1876270617038336:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 213us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351336.507179:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 72 00000100:00100000:0.0:1789351336.509479:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351336.509543:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617038464 00000100:00100000:1.0:1789351336.509558:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617038464 00000100:00100000:1.0:1789351336.509632:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 73 00000100:00100000:1.0:1789351336.509644:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+6:13724:x1876270617038464:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789351336.510011:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+6:13724:x1876270617038464:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 368us (542us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789351336.510023:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 73 00000100:00100000:0.0:1789351336.512546:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351336.512639:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617038592 00000100:00100000:1.0:1789351336.512649:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617038592 00000100:00100000:1.0:1789351336.512708:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:1.0:1789351336.512719:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+6:13724:x1876270617038592:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789351336.512736:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351336.512754:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ceecc5400/0xa6ea017771df7f01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d805b expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351336.512784:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecc5400/0xa6ea017771df7f01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d805b expref: 7 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351336.512795:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ceecc5400/0xa6ea017771df7f01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d805b expref: 7 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351336.512804:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5400, rc 0) 00000100:00100000:1.0:1789351336.512887:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7356050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+7:13724:x1876270617038592:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 169us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351336.512894:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 74 00000100:00100000:0.0:1789351336.514314:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351336.514558:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617038720 00000100:00100000:2.0:1789351336.514566:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617038720 00000100:00100000:2.0:1789351336.514651:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00100000:2.0:1789351336.514661:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+7:13724:x1876270617038720:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789351336.514942:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+8:13724:x1876270617038720:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 282us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351336.514950:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 75 00000100:00100000:0.0:1789351336.516835:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351336.517062:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617038848 00000100:00100000:3.0:1789351336.517070:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617038848 00000100:00100000:3.0:1789351336.517159:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:3.0:1789351336.517172:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+8:13724:x1876270617038848:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789351336.517647:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+8:13724:x1876270617038848:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 476us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351336.517655:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 76 00000100:00100000:0.0:1789351336.519469:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351336.520094:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617038976 00000100:00100000:2.0:1789351336.520103:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617038976 00000100:00100000:2.0:1789351336.520156:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 77 00000100:00100000:2.0:1789351336.520167:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+8:13743:x1876270617038976:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789351336.520543:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7355c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+8:13743:x1876270617038976:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 376us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351336.520552:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 77 00000100:00100000:0.0:1789351336.528326:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351336.528472:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617039104 00000100:00100000:3.0:1789351336.528482:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617039104 00000100:00100000:3.0:1789351336.528538:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:3.0:1789351336.528547:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+8:13743:x1876270617039104:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789351336.528841:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7356850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+8:13743:x1876270617039104:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 294us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351336.528849:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 78 00000100:00100000:0.0:1789351336.530866:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351336.531101:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617039232 00000100:00100000:2.0:1789351336.531109:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617039232 00000100:00100000:2.0:1789351336.531169:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00100000:2.0:1789351336.531193:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+8:13724:x1876270617039232:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789351336.531206:0:14277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351336.531222:0:14277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7f08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8085 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351336.531243:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7f08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8085 expref: 9 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351336.531251:0:14277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d00bc1600/0xa6ea017771df7f08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8085 expref: 9 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351336.531258:0:14277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc1600, rc 0) 00000100:00100000:2.0:1789351336.531306:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7357850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+9:13724:x1876270617039232:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 113us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351336.531313:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 79 00000100:00100000:0.0:1789351336.533327:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351336.533466:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617039360 00000100:00100000:1.0:1789351336.533475:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617039360 00000100:00100000:1.0:1789351336.533566:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:1.0:1789351336.533577:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+9:13724:x1876270617039360:12345-192.168.201.52@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789351336.533601:0:14275:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789351336.533624:0:14275:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789351336.533628:0:14275:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789351336.533631:0:14275:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789351336.533633:0:14275:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789351336.534723:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7354850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+9:13724:x1876270617039360:12345-192.168.201.52@tcp:256:mount.lustre.0 Request processed in 1143us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351336.534734:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 80 00000100:00100000:0.0:1789351336.544793:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351336.544862:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617039488 00000100:00100000:2.0:1789351336.544871:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617039488 00000100:00100000:2.0:1789351336.544983:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:2.0:1789351336.544994:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+9:13724:x1876270617039488:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789351336.545011:0:14277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351336.545029:0:14277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d00bc0c00/0xa6ea017771df7f0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d808c expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351336.545054:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d00bc0c00/0xa6ea017771df7f0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d808c expref: 10 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351336.545063:0:14277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d00bc0c00/0xa6ea017771df7f0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d808c expref: 10 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351336.545085:0:14277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0c00, rc 0) 00000100:00100000:2.0:1789351336.545135:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+10:13724:x1876270617039488:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 143us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351336.545140:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 81 00000100:00100000:2.0:1789351336.546527:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351336.546636:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617039616 00000100:00100000:1.0:1789351336.546644:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617039616 00000100:00100000:1.0:1789351336.546724:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:1.0:1789351336.546734:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+10:13724:x1876270617039616:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789351336.547029:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+10:13724:x1876270617039616:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 295us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351336.547037:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 82 00000100:00100000:0.0:1789351336.549424:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351336.549572:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617039744 00000100:00100000:2.0:1789351336.549581:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617039744 00000100:00100000:2.0:1789351336.549669:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00100000:2.0:1789351336.549680:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+10:13724:x1876270617039744:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789351336.549958:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+10:13724:x1876270617039744:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 279us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351336.549967:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 83 00000100:00100000:0.0:1789351336.552252:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351336.552392:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617039872 00000100:00100000:1.0:1789351336.552401:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617039872 00000100:00100000:1.0:1789351336.552449:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:1.0:1789351336.552459:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+10:13747:x1876270617039872:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789351336.552723:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+10:13747:x1876270617039872:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 265us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351336.552731:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 84 00000100:00100000:0.0:1789351336.557561:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351336.557728:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617040000 00000100:00100000:2.0:1789351336.557738:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617040000 00000100:00100000:2.0:1789351336.557837:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:2.0:1789351336.557848:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+10:13747:x1876270617040000:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789351336.558108:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+10:13747:x1876270617040000:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 262us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351336.558125:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 85 00000100:00100000:0.0:1789351336.560028:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351336.560489:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617040128 00000100:00100000:1.0:1789351336.560497:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617040128 00000100:00100000:1.0:1789351336.560575:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:1.0:1789351336.560584:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2346:x1876270617040128:12345-192.168.201.52@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789351336.560612:0:14284:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 53889ff8-25a9-4f06-adfc-5fffc69706fc@192.168.201.52@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:1.0:1789351336.560658:0:14284:0:(genops.c:1406:class_connect()) connect: client 53889ff8-25a9-4f06-adfc-5fffc69706fc, cookie 0xa6ea017771df7f16 00000004:00100000:1.0:1789351336.560687:0:14284:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789351336.560693:0:14284:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789351336.589683:0:14284:0:(import.c:65:import_set_state_nolock()) ffff8d2cc31af800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789351336.589759:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:2346:x1876270617040128:12345-192.168.201.52@tcp:38:mount.lustre.0 Request processed in 29173us (29734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351336.589770:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:0.0:1789351336.595569:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351336.595615:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351336.595778:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617040384 00000100:00100000:3.0:1789351336.595789:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617040384 00000100:00100000:3.0:1789351336.595929:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617040256 00000100:00100000:3.0:1789351336.595933:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617040256 00000100:00100000:3.0:1789351336.595952:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:3.0:1789351336.595962:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+7:13724:x1876270617040384:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789351336.596007:0:14283:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789351336.596085:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+7:13724:x1876270617040384:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 124us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351336.596092:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:3.0:1789351336.596108:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:3.0:1789351336.596126:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:0:x1876270617040256:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789351336.596136:0:14283:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789351336.596156:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:0:x1876270617040256:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 42us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351336.596162:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00080000:2.0:1789351336.597248:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789351336.597835:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351336.598093:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617040512 00000100:00100000:3.0:1789351336.598101:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617040512 00000100:00100000:3.0:1789351336.598240:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1789351336.598250:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:13724:x1876270617040512:12345-192.168.201.52@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789351336.598323:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:13724:x1876270617040512:12345-192.168.201.52@tcp:40:mount.lustre.0 Request processed in 74us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351336.598331:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1789351336.599898:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351336.599927:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351336.600008:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351336.600081:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617040640 00000100:00100000:1.0:1789351336.600089:0:14967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617040640 00000100:00100000:1.0:1789351336.600182:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617040768 00000100:00100000:1.0:1789351336.600187:0:14967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617040768 00000100:00100000:2.0:1789351336.600242:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617040896 00000100:00100000:2.0:1789351336.600247:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617040896 00000100:00100000:2.0:1789351336.600280:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:2.0:1789351336.600289:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:13724:x1876270617040896:12345-192.168.201.52@tcp:33:mount.lustre.0 00000100:00100000:0.0:1789351336.600463:0:14966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:0.0:1789351336.600470:0:14966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1876270617040640:12345-192.168.201.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789351336.600501:0:14966:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 53889ff8-25a9-4f06-adfc-5fffc69706fc@192.168.201.52@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:0.0:1789351336.600528:0:14966:0:(genops.c:1406:class_connect()) connect: client 53889ff8-25a9-4f06-adfc-5fffc69706fc, cookie 0xa6ea017771df7f1d 00002000:00100000:0.0:1789351336.600539:0:14966:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 53889ff8-25a9-4f06-adfc-5fffc69706fc/ffff8d2bc1981800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789351336.600563:0:14966:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789351336.601266:0:14966:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789351336.601295:0:14966:0:(import.c:65:import_set_state_nolock()) ffff8d2bc1984800 : changing import state from RECOVER to FULL 00000004:00080000:2.0:1789351336.601391:0:14286:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1038us 00000100:00100000:0.0:1789351336.601495:0:14966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:2346:x1876270617040640:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 1021us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351336.601504:0:14966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:0.0:1789351336.601525:0:14966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:0.0:1789351336.601531:0:14966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1876270617040768:12345-192.168.201.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789351336.601549:0:14966:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 53889ff8-25a9-4f06-adfc-5fffc69706fc@192.168.201.52@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:0.0:1789351336.601568:0:14966:0:(genops.c:1406:class_connect()) connect: client 53889ff8-25a9-4f06-adfc-5fffc69706fc, cookie 0xa6ea017771df7f24 00002000:00100000:0.0:1789351336.601576:0:14966:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 53889ff8-25a9-4f06-adfc-5fffc69706fc/ffff8d2bc1980000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789351336.601591:0:14966:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789351336.601891:0:14966:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789351336.601910:0:14966:0:(import.c:65:import_set_state_nolock()) ffff8d2bc1985000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789351336.601939:0:14966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:2346:x1876270617040768:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 406us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351336.601954:0:14966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000004:00200000:2.0:1789351336.612584:0:14286:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1789351336.613123:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:13724:x1876270617040896:12345-192.168.201.52@tcp:33:mount.lustre.0 Request processed in 12831us (13189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351336.613132:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:3.0:1789351336.708062:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351336.708174:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617041024 00000100:00100000:1.0:1789351336.708183:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617041024 00000100:00100000:1.0:1789351336.708243:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:1.0:1789351336.708253:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:13768:x1876270617041024:12345-192.168.201.52@tcp:101:mkdir.0 00010000:00010000:1.0:1789351336.708273:0:14285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351336.708301:0:14285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df7f2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d80b6 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351336.708941:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7f32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351336.708955:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7f32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351336.708970:0:14285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7f32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351336.709839:0:14285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789351336.709845:0:14285:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1789351336.709961:0:14285:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7f32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351336.709994:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4000/0xa6ea017771df7f2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d80b6 expref: 8 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351336.710012:0:14285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7f32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d80b6 expref: 7 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351336.710021:0:14285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:1.0:1789351336.710024:0:14285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789351336.710027:0:14285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4800, rc 0) 00000100:00100000:1.0:1789351336.710098:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+7:13768:x1876270617041024:12345-192.168.201.52@tcp:101:mkdir.0 Request processed in 1846us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351336.710106:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00080000:2.0:1789351337.121555:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789351337.121561:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789351337.121565:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2cc308b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1789351337.121577:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3288:1876270626456064:0@lo:400:kworker.0 00000100:00080000:2.0:1789351337.121577:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2cc308b000 using connection 192.168.201.152@tcp/0@lo 00000100:00100000:2.0:1789351337.121604:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2cffadad80 x1876270626456320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789351337.121662:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351337.121672:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626456448:0@lo:400:kworker.0 00000100:00100000:2.0:1789351337.121711:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351337.121732:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626456704:0@lo:400:kworker.0 00000100:00100000:2.0:1789351337.121739:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789351337.121748:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876270626456576:0@lo:400:kworker.0 00000100:00100000:3.0:1789351337.121765:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351337.121783:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351337.121786:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789351337.121795:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626456192:0@lo:400:kworker.0 00000100:00100000:3.0:1789351337.121826:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351337.121832:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626456064 00000100:00100000:2.0:1789351337.121840:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626456064 00000100:00100000:3.0:1789351337.121876:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626456448 00000100:00100000:0.0:1789351337.121878:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626456704 00000100:00100000:3.0:1789351337.121882:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626456448 00000100:00100000:0.0:1789351337.121885:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626456704 00000100:00100000:2.0:1789351337.121891:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789351337.121902:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:3288:x1876270626456064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351337.121911:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626456576 00000100:00100000:3.0:1789351337.121915:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626456576 00000100:00100000:0.0:1789351337.121925:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789351337.121936:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626456448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351337.121939:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789351337.121947:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789351337.121963:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:3288:x1876270626456064:12345-0@lo:400:kworker.0 Request processed in 63us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351337.121970:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789351337.121976:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876270626456448:12345-0@lo:400:kworker.0 Request processed in 45us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351337.121982:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789351337.121987:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626456192 00000100:00100000:3.0:1789351337.121990:0:14965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626456192 00000100:00100000:0.0:1789351337.122001:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789351337.122011:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876270626456704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351337.122023:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789351337.122033:0:14965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626456192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789351337.122041:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876270626456704:12345-0@lo:400:kworker.0 Request processed in 33us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351337.122048:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789351337.122064:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789351337.122073:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876270626456576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351337.122076:0:14965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626456192:12345-0@lo:400:kworker.0 Request processed in 44us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351337.122085:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789351337.122109:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876270626456576:12345-0@lo:400:kworker.0 Request processed in 37us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351337.122114:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789351337.122119:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626456192:0@lo:400:kworker.0 00000100:00080000:0.0:1789351337.122135:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789351337.122139:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789351337.122149:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626456704:0@lo:400:kworker.0 00000100:00100000:2.0:1789351337.122157:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3288:1876270626456064:0@lo:400:kworker.0 00000100:00100000:0.0:1789351337.122158:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876270626456576:0@lo:400:kworker.0 00000100:00100000:0.0:1789351337.122166:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876270626456448:0@lo:400:kworker.0 00000100:00100000:1.0:1789351337.122257:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626456320:0@lo:8:kworker.0 00000100:00100000:1.0:1789351337.122287:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351337.122848:0:14966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626456320 00000100:00100000:0.0:1789351337.122853:0:14966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626456320 00000100:00100000:0.0:1789351337.122888:0:14966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789351337.122900:0:14966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1876270626456320:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789351337.122924:0:14966:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:0.0:1789351337.122949:0:14966:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6ea017771df7f39 00002000:00100000:0.0:1789351337.122962:0:14966:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d2bc1983000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789351337.122967:0:14966:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789351337.122969:0:14966:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789351337.123190:0:14966:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789351337.123209:0:14966:0:(import.c:65:import_set_state_nolock()) ffff8d2bc1987000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789351337.123259:0:14966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1876270626456320:12345-0@lo:8:kworker.0 Request processed in 358us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351337.123266:0:14966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789351337.123341:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2cffadad80 x1876270626456320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789351362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789351337.123353:0:3285:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789351337.123377:0:3285:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789351337.123382:0:3285:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789351337.123385:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8d2cc308b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789351337.123406:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789351337.123413:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876270626456320:0@lo:8:kworker.0 00000004:00080000:3.0:1789351337.123430:0:14308:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1789351337.123452:0:14308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec45f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14308:1876270626456960:0@lo:5:osp-pre-1-0.0 00000040:00080000:0.0:1789351337.123510:0:14307:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 9 count 2 00000100:00100000:0.0:1789351337.123543:0:3289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626456832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789351337.123551:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789351337.123560:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceee15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626457088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789351337.123572:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351337.123585:0:14308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351337.123613:0:14308:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2bc3941b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789351337.123629:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626456960 00000100:00100000:3.0:1789351337.123633:0:14967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626456960 00000100:00100000:2.0:1789351337.123669:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351337.123674:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789351337.123689:0:14967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14308:x1876270626456960:12345-0@lo:5:osp-pre-1-0.0 00000040:00080000:0.0:1789351337.123741:0:14307:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789351337.123745:0:14307:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1789351337.123805:0:14968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626456832 00000100:00100000:1.0:1789351337.123809:0:14968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626456832 00000100:00100000:1.0:1789351337.123841:0:14968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789351337.123847:0:14968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1876270626456832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789351337.123858:0:14968:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789351337.123908:0:14968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1876270626456832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351337.123913:0:14968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789351337.127136:0:14965:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789351337.127148:0:14965:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789351337.127292:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626457088 00000100:00100000:2.0:1789351337.127300:0:14965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626457088 00000100:00100000:2.0:1789351337.127437:0:16151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789351337.127450:0:16151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3287:x1876270626457088:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1789351337.127534:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789351337.127949:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ceec45880 x1876270626456832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789351353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789351337.127972:0:3289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876270626456832:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1789351337.128243:0:14307:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00002000:00080000:3.0:1789351337.128557:0:14967:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789351337.128565:0:14967:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789351337.128569:0:14967:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000004:00080000:0.0:1789351337.129031:0:14307:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 281574672717ns, next at 0ns, rc = 0 00002000:00010000:3.0:1789351337.134502:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.134514:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df7f40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.134532:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.134537:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.134543:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df7f40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.134562:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df7f40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.134572:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df7f40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.134580:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df7f40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.134602:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789351337.134616:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351337.134622:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df7f40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.134641:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105e00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351337.134646:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df7f40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.134656:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df7f40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.134672:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df7f40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.134680:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d9d4cfa/0xa6ea017771df7f40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.134696:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.134698:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.134700:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789351337.135134:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.135141:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6f7aa44/0xa6ea017771df7f47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135149:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.135153:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.135157:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f7aa44/0xa6ea017771df7f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135166:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6f7aa44/0xa6ea017771df7f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135180:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6f7aa44/0xa6ea017771df7f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135188:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f7aa44/0xa6ea017771df7f47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135210:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789351337.135587:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.135591:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095bcc8db/0xa6ea017771df7f4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135597:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.135599:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.135602:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095bcc8db/0xa6ea017771df7f4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135608:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095bcc8db/0xa6ea017771df7f4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135612:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095bcc8db/0xa6ea017771df7f4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135617:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095bcc8db/0xa6ea017771df7f4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135634:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789351337.135640:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789351337.135643:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6f7aa44/0xa6ea017771df7f47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135648:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104400 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351337.135650:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6f7aa44/0xa6ea017771df7f47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135655:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6f7aa44/0xa6ea017771df7f47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135662:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6f7aa44/0xa6ea017771df7f47 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135669:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6f7aa44/0xa6ea017771df7f47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135681:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351337.135685:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095bcc8db/0xa6ea017771df7f4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135691:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351337.135694:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095bcc8db/0xa6ea017771df7f4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135712:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095bcc8db/0xa6ea017771df7f4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135723:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095bcc8db/0xa6ea017771df7f4e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135731:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095bcc8db/0xa6ea017771df7f4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.135742:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.135744:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.135745:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351337.135784:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789351337.136134:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.136140:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d190376/0xa6ea017771df7f55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.136146:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.136148:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.136151:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d190376/0xa6ea017771df7f55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.136157:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d190376/0xa6ea017771df7f55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.136161:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d190376/0xa6ea017771df7f55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.136172:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d190376/0xa6ea017771df7f55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.136188:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789351337.136398:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789351337.136404:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d190376/0xa6ea017771df7f55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.136413:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105400 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351337.136418:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d190376/0xa6ea017771df7f55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.136439:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d190376/0xa6ea017771df7f55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.136456:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d190376/0xa6ea017771df7f55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.136464:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d190376/0xa6ea017771df7f55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.136485:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351337.136488:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351337.136490:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789351337.136526:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.136531:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7f5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.136537:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.136539:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.136541:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7f5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.136549:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7f5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.136556:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7f5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.136563:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.136584:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789351337.136838:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789351337.136844:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.136853:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104a00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351337.136857:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.136877:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7f5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.136888:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7f5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.136907:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff70579/0xa6ea017771df7f5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.136921:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351337.136923:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351337.136925:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789351337.137078:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.137084:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e16449f/0xa6ea017771df7f63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.137153:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.137158:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.137163:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e16449f/0xa6ea017771df7f63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.137174:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e16449f/0xa6ea017771df7f63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.137182:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e16449f/0xa6ea017771df7f63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.137189:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e16449f/0xa6ea017771df7f63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.137248:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789351337.137701:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.137707:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bd1f249/0xa6ea017771df7f6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.137714:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.137717:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.137721:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bd1f249/0xa6ea017771df7f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.137729:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bd1f249/0xa6ea017771df7f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.137747:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bd1f249/0xa6ea017771df7f6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.137755:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bd1f249/0xa6ea017771df7f6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.138042:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789351337.138048:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e16449f/0xa6ea017771df7f63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.138057:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105200 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351337.138061:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e16449f/0xa6ea017771df7f63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.138070:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e16449f/0xa6ea017771df7f63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.138083:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e16449f/0xa6ea017771df7f63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.138091:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e16449f/0xa6ea017771df7f63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.138163:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789351337.138168:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bd1f249/0xa6ea017771df7f6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.138182:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105800 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351337.138185:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bd1f249/0xa6ea017771df7f6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.138193:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bd1f249/0xa6ea017771df7f6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.138205:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bd1f249/0xa6ea017771df7f6a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.138213:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351337.138214:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351337.138216:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.138275:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789351337.138280:0:14967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bd1f249/0xa6ea017771df7f6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789351337.138727:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.138733:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6188cc2/0xa6ea017771df7f71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.138742:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.138746:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.138750:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6188cc2/0xa6ea017771df7f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.138759:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6188cc2/0xa6ea017771df7f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.138765:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6188cc2/0xa6ea017771df7f71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.138777:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6188cc2/0xa6ea017771df7f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.139326:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789351337.139331:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6188cc2/0xa6ea017771df7f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.139337:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105000 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351337.139339:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6188cc2/0xa6ea017771df7f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.139345:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6188cc2/0xa6ea017771df7f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.139352:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6188cc2/0xa6ea017771df7f71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.139372:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351337.139373:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351337.139374:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.139445:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789351337.139449:0:14967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6188cc2/0xa6ea017771df7f71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789351337.139822:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.139828:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df7f78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.139837:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.139840:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.139845:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df7f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.139854:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df7f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.139874:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df7f78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.139883:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df7f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.139894:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.139910:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789351337.139918:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789351337.139922:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df7f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.139930:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3105c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351337.139934:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df7f78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.139942:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df7f78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.139953:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df7f78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.139960:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd73865f/0xa6ea017771df7f78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.139974:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351337.139975:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351337.139977:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789351337.140293:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.140297:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df580515/0xa6ea017771df7f7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.140303:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.140305:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.140307:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df580515/0xa6ea017771df7f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.140313:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df580515/0xa6ea017771df7f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.140318:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df580515/0xa6ea017771df7f7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.140323:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df580515/0xa6ea017771df7f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.140335:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789351337.140383:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789351337.140388:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df580515/0xa6ea017771df7f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.140401:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cc3104000 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351337.140404:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df580515/0xa6ea017771df7f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.140412:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df580515/0xa6ea017771df7f7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.140423:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df580515/0xa6ea017771df7f7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.140430:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df580515/0xa6ea017771df7f7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.140444:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351337.140446:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351337.140447:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789351337.140653:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.140657:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7f86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.140662:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.140667:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.140670:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7f86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.140676:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7f86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.140681:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7f86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.140685:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7f86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.140726:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789351337.140727:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789351337.140731:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7f86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.140738:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351337.140742:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7f86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.140750:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7f86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.140766:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7f86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.140774:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b0d9b8e/0xa6ea017771df7f86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.140858:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351337.140861:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789351337.140871:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789351337.141068:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.141073:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081890290/0xa6ea017771df7f8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.141080:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.141082:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.141085:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081890290/0xa6ea017771df7f8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.141094:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081890290/0xa6ea017771df7f8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.141162:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081890290/0xa6ea017771df7f8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.141176:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081890290/0xa6ea017771df7f8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.141194:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789351337.142678:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.142685:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7f94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.142695:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.142697:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.142701:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.142710:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.142717:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7f94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.142724:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.142739:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789351337.142748:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789351337.142752:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081890290/0xa6ea017771df7f8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.142766:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8000 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351337.142769:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081890290/0xa6ea017771df7f8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.142778:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081890290/0xa6ea017771df7f8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.142789:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081890290/0xa6ea017771df7f8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.142797:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081890290/0xa6ea017771df7f8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.142811:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351337.142815:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.142821:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8e00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351337.142824:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7f94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.142832:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7f94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.142842:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7f94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.142856:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca57715f/0xa6ea017771df7f94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.142878:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.142880:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.142882:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789351337.143296:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.143302:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eff1f6b/0xa6ea017771df7f9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.143310:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.143313:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.143317:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008eff1f6b/0xa6ea017771df7f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.143325:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008eff1f6b/0xa6ea017771df7f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.143333:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eff1f6b/0xa6ea017771df7f9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.143341:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008eff1f6b/0xa6ea017771df7f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351337.143431:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.144752:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789351337.145180:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.145191:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e2bd92b/0xa6ea017771df7fa2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.145203:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.145207:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.145212:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e2bd92b/0xa6ea017771df7fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.145224:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e2bd92b/0xa6ea017771df7fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.145232:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e2bd92b/0xa6ea017771df7fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.145238:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e2bd92b/0xa6ea017771df7fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.145250:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789351337.145696:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.145703:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d7a0ad5/0xa6ea017771df7fa9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.145712:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.145715:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.145720:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d7a0ad5/0xa6ea017771df7fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.145730:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d7a0ad5/0xa6ea017771df7fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.145745:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d7a0ad5/0xa6ea017771df7fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.145752:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d7a0ad5/0xa6ea017771df7fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.145761:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789351337.146175:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.146181:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065ab0161/0xa6ea017771df7fb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.146189:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.146192:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.146195:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065ab0161/0xa6ea017771df7fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.146204:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065ab0161/0xa6ea017771df7fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.146212:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065ab0161/0xa6ea017771df7fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.146219:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065ab0161/0xa6ea017771df7fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.146238:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789351337.146905:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.146911:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c18cc64/0xa6ea017771df7fb7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.146920:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.146922:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.146925:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c18cc64/0xa6ea017771df7fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.146931:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c18cc64/0xa6ea017771df7fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.146936:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c18cc64/0xa6ea017771df7fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.146941:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c18cc64/0xa6ea017771df7fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.146946:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1789351337.147231:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.147236:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036f207f0/0xa6ea017771df7fbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.147245:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.147253:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.147257:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036f207f0/0xa6ea017771df7fbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.147267:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036f207f0/0xa6ea017771df7fbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.147275:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036f207f0/0xa6ea017771df7fbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.147282:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036f207f0/0xa6ea017771df7fbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.147290:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1789351337.147683:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.147689:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005979887c/0xa6ea017771df7fc5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.147698:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.147700:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.147704:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005979887c/0xa6ea017771df7fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.147714:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005979887c/0xa6ea017771df7fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.147722:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005979887c/0xa6ea017771df7fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.147735:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005979887c/0xa6ea017771df7fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.147743:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1789351337.147978:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1789351337.147986:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008eff1f6b/0xa6ea017771df7f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.147995:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9200 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351337.147999:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008eff1f6b/0xa6ea017771df7f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148019:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008eff1f6b/0xa6ea017771df7f9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148038:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008eff1f6b/0xa6ea017771df7f9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148046:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008eff1f6b/0xa6ea017771df7f9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148066:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789351337.148071:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e2bd92b/0xa6ea017771df7fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148079:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8400 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351337.148082:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e2bd92b/0xa6ea017771df7fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148089:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e2bd92b/0xa6ea017771df7fa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148100:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e2bd92b/0xa6ea017771df7fa2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148107:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e2bd92b/0xa6ea017771df7fa2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148130:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789351337.148133:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d7a0ad5/0xa6ea017771df7fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148139:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9400 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351337.148141:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d7a0ad5/0xa6ea017771df7fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148148:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d7a0ad5/0xa6ea017771df7fa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148157:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d7a0ad5/0xa6ea017771df7fa9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148164:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d7a0ad5/0xa6ea017771df7fa9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148174:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789351337.148178:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065ab0161/0xa6ea017771df7fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148184:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8600 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351337.148187:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065ab0161/0xa6ea017771df7fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148204:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065ab0161/0xa6ea017771df7fb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148215:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065ab0161/0xa6ea017771df7fb0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148222:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065ab0161/0xa6ea017771df7fb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148236:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789351337.148240:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c18cc64/0xa6ea017771df7fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148246:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9600 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351337.148249:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c18cc64/0xa6ea017771df7fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148258:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c18cc64/0xa6ea017771df7fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148270:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c18cc64/0xa6ea017771df7fb7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148277:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c18cc64/0xa6ea017771df7fb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148301:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789351337.148304:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036f207f0/0xa6ea017771df7fbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148312:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9800 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351337.148315:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036f207f0/0xa6ea017771df7fbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148323:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036f207f0/0xa6ea017771df7fbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148334:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036f207f0/0xa6ea017771df7fbe lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148342:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036f207f0/0xa6ea017771df7fbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148376:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789351337.148380:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005979887c/0xa6ea017771df7fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148387:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8200 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351337.148391:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005979887c/0xa6ea017771df7fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148409:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005979887c/0xa6ea017771df7fc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148420:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005979887c/0xa6ea017771df7fc5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148428:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005979887c/0xa6ea017771df7fc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.148443:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351337.148445:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351337.148448:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351337.148692:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789351337.149832:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.149840:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c535ecd/0xa6ea017771df7fcc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.149853:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.149857:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.149871:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c535ecd/0xa6ea017771df7fcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.149885:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c535ecd/0xa6ea017771df7fcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.149893:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c535ecd/0xa6ea017771df7fcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.149901:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c535ecd/0xa6ea017771df7fcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.149956:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789351337.150482:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.150489:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000693ed126/0xa6ea017771df7fd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.150506:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.150509:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.150514:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000693ed126/0xa6ea017771df7fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.150524:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000693ed126/0xa6ea017771df7fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.150532:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000693ed126/0xa6ea017771df7fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.150539:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000693ed126/0xa6ea017771df7fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.153097:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789351337.153165:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c535ecd/0xa6ea017771df7fcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.153177:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c4c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351337.153181:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c535ecd/0xa6ea017771df7fcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.153190:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c535ecd/0xa6ea017771df7fcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.153209:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c535ecd/0xa6ea017771df7fcc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.153229:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c535ecd/0xa6ea017771df7fcc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.153257:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789351337.153261:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000693ed126/0xa6ea017771df7fd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.153268:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c5c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351337.153272:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000693ed126/0xa6ea017771df7fd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.153280:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000693ed126/0xa6ea017771df7fd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.153293:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000693ed126/0xa6ea017771df7fd3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351337.153299:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351337.153301:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351337.153303:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.154199:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789351337.154208:0:14967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000693ed126/0xa6ea017771df7fd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.154237:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789351337.154777:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.154784:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021b37086/0xa6ea017771df7fda lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.154797:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.154801:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.154808:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021b37086/0xa6ea017771df7fda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.154827:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021b37086/0xa6ea017771df7fda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.154836:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021b37086/0xa6ea017771df7fda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.154844:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021b37086/0xa6ea017771df7fda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.154859:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789351337.154879:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351337.154884:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021b37086/0xa6ea017771df7fda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.154892:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c5e00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351337.154896:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021b37086/0xa6ea017771df7fda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.154904:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021b37086/0xa6ea017771df7fda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.154917:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021b37086/0xa6ea017771df7fda lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.154923:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021b37086/0xa6ea017771df7fda lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.154943:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.154945:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.154947:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789351337.155482:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.155489:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008955036/0xa6ea017771df7fe1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.155498:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.155501:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.155505:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008955036/0xa6ea017771df7fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.155514:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008955036/0xa6ea017771df7fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.155522:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008955036/0xa6ea017771df7fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.155530:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008955036/0xa6ea017771df7fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.155544:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789351337.155552:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351337.155555:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008955036/0xa6ea017771df7fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.155574:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c5800 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351337.155578:0:14271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008955036/0xa6ea017771df7fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.155585:0:14271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008955036/0xa6ea017771df7fe1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.155597:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008955036/0xa6ea017771df7fe1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.155610:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008955036/0xa6ea017771df7fe1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.155625:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.155627:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.155629:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789351337.156101:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.156107:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041c0a77b/0xa6ea017771df7fe8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.156116:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.156119:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.156123:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041c0a77b/0xa6ea017771df7fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.156132:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041c0a77b/0xa6ea017771df7fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.156147:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041c0a77b/0xa6ea017771df7fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.156154:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041c0a77b/0xa6ea017771df7fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.156170:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789351337.156178:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351337.156182:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041c0a77b/0xa6ea017771df7fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.156189:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c4200 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351337.156193:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041c0a77b/0xa6ea017771df7fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.156201:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041c0a77b/0xa6ea017771df7fe8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.156214:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041c0a77b/0xa6ea017771df7fe8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.156221:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041c0a77b/0xa6ea017771df7fe8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.156240:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.156247:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.156250:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789351337.156709:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.156715:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007350b25b/0xa6ea017771df7fef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.156723:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.156726:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.156730:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007350b25b/0xa6ea017771df7fef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.156739:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007350b25b/0xa6ea017771df7fef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.156746:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007350b25b/0xa6ea017771df7fef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.156753:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007350b25b/0xa6ea017771df7fef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.156781:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789351337.157241:0:14967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789351337.157248:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003da046c4/0xa6ea017771df7ff6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.157256:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=281s v=(0 0) 00010000:00010000:3.0:1789351337.157260:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351337.157264:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003da046c4/0xa6ea017771df7ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.157280:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003da046c4/0xa6ea017771df7ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.157289:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003da046c4/0xa6ea017771df7ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.157297:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003da046c4/0xa6ea017771df7ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.157313:0:14967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789351337.157321:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789351337.157325:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007350b25b/0xa6ea017771df7fef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.157333:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c4a00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351337.157337:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007350b25b/0xa6ea017771df7fef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.157347:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007350b25b/0xa6ea017771df7fef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.157383:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007350b25b/0xa6ea017771df7fef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.157392:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007350b25b/0xa6ea017771df7fef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.157416:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789351337.157419:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003da046c4/0xa6ea017771df7ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.157425:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d021c4000 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351337.157428:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003da046c4/0xa6ea017771df7ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.157435:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003da046c4/0xa6ea017771df7ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.157444:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003da046c4/0xa6ea017771df7ff6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.157451:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003da046c4/0xa6ea017771df7ff6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351337.157465:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.157467:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351337.157469:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789351337.157688:0:14967:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1789351337.157795:0:14967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:14308:x1876270626456960:12345-0@lo:5:osp-pre-1-0.0 Request processed in 34104us (34208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351337.157806:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789351337.157890:0:14308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec45f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14308:1876270626456960:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789351337.157908:0:14308:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789351337.157965:0:14308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14308:1876270626457216:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789351337.158006:0:14308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351337.158056:0:14308:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2d273c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789351337.158088:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626457216 00000100:00100000:2.0:1789351337.158093:0:14965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626457216 00000100:00100000:2.0:1789351337.158251:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789351337.158261:0:14965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:14308:x1876270626457216:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789351337.158299:0:14965:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1789351337.158474:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789351337.165290:0:14965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:14308:x1876270626457216:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7027us (7281us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789351337.165300:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789351337.165384:0:14308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14308:1876270626457216:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789351337.165397:0:14308:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00100000:3.0:1789351337.166073:0:7616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 53889ff8-25a9-4f06-adfc-5fffc69706fc 00000004:00080000:2.0:1789351337.184145:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:2.0:1789351337.184170:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 53889ff8-25a9-4f06-adfc-5fffc69706fc 00010000:00010000:3.0:1789351337.187092:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351337.213462:0:16151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3287:x1876270626457088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86009us (89786us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789351337.213476:0:16151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000001:00100000:3.0:1789351337.213513:0:7616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789351337.213526:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000004:00080000:2.0:1789351337.213533:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2ceee15180/2, rc 0, transno 8589934593 00000001:00080000:3.0:1789351337.213534:0:7616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:2.0:1789351337.213544:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceee15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626457088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789351338.169490:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351338.169587:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617041152 00000100:00100000:0.0:1789351338.169597:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617041152 00000100:00100000:0.0:1789351338.169711:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:0.0:1789351338.169722:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:13820:x1876270617041152:12345-192.168.201.52@tcp:41:lfs.0 00000004:00000024:0.0:1789351338.169764:0:14284:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789351338.169870:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:13820:x1876270617041152:12345-192.168.201.52@tcp:41:lfs.0 Request processed in 149us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351338.169879:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00080000:2.0:1789351338.170164:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789351338.173306:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351338.173408:0:14968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617041280 00000100:00100000:1.0:1789351338.173417:0:14968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617041280 00000100:00100000:1.0:1789351338.173502:0:14968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:1.0:1789351338.173516:0:14968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:13820:x1876270617041280:12345-192.168.201.52@tcp:13:lfs.0 00002000:00000024:1.0:1789351338.173544:0:14968:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789351338.173636:0:14968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:13820:x1876270617041280:12345-192.168.201.52@tcp:13:lfs.0 Request processed in 122us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351338.173644:0:14968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00080000:2.0:1789351338.173779:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789351338.179439:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351338.179555:0:14969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617041408 00000100:00100000:3.0:1789351338.179565:0:14969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617041408 00000100:00100000:3.0:1789351338.179686:0:14969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:3.0:1789351338.179697:0:14969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:53889ff8-25a9-4f06-adfc-5fffc69706fc+5:13820:x1876270617041408:12345-192.168.201.52@tcp:13:lfs.0 00002000:00000024:3.0:1789351338.179720:0:14969:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789351338.179800:0:14969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:53889ff8-25a9-4f06-adfc-5fffc69706fc+5:13820:x1876270617041408:12345-192.168.201.52@tcp:13:lfs.0 Request processed in 106us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351338.179808:0:14969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00080000:2.0:1789351338.180283:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789351338.209591:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789351338.250477:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351338.250958:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617041536 00000100:00100000:2.0:1789351338.250980:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617041536 00000100:00100000:2.0:1789351338.251048:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:2.0:1789351338.251059:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+10:13852:x1876270617041536:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789351338.251081:0:14277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351338.251113:0:14277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d00bc0a00/0xa6ea017771df7ffd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d80bd expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351338.251149:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d00bc0a00/0xa6ea017771df7ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d80bd expref: 11 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351338.251162:0:14277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d00bc0a00/0xa6ea017771df7ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d80bd expref: 11 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351338.251173:0:14277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0a00, rc 0) 00000100:00100000:2.0:1789351338.251248:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+11:13852:x1876270617041536:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 190us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351338.251277:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 87 00000100:00100000:0.0:1789351338.253101:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351338.253222:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617041664 00000100:00100000:3.0:1789351338.253232:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617041664 00000100:00100000:3.0:1789351338.253289:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:3.0:1789351338.253301:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+11:13852:x1876270617041664:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789351338.254310:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+11:13852:x1876270617041664:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 1008us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351338.254322:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 88 00000100:00100000:1.0:1789351338.260821:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351338.261120:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617041792 00000100:00100000:3.0:1789351338.261134:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617041792 00000100:00100000:3.0:1789351338.261208:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:3.0:1789351338.261221:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+11:13852:x1876270617041792:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789351338.261664:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+11:13852:x1876270617041792:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 446us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351338.261674:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 89 00000100:00100000:2.0:1789351338.266538:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351338.267219:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617041920 00000100:00100000:3.0:1789351338.267233:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617041920 00000100:00100000:3.0:1789351338.267309:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:3.0:1789351338.267322:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+11:13859:x1876270617041920:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789351338.267767:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+11:13859:x1876270617041920:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 446us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351338.267777:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 90 00000100:00100000:0.0:1789351338.277173:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351338.277528:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617042048 00000100:00100000:3.0:1789351338.277541:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617042048 00000100:00100000:2.0:1789351338.277650:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:2.0:1789351338.277666:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+11:13859:x1876270617042048:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789351338.278110:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+11:13859:x1876270617042048:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 448us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351338.278119:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 91 00000100:00100000:1.0:1789351338.285450:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351338.285559:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617042176 00000100:00100000:3.0:1789351338.285574:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617042176 00000100:00100000:3.0:1789351338.285643:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:3.0:1789351338.285654:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+11:13852:x1876270617042176:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789351338.285672:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351338.285692:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df8004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d80e7 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351338.285724:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df8004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d80e7 expref: 12 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351338.285733:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d021c4000/0xa6ea017771df8004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d80e7 expref: 12 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351338.285742:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c4000, rc 0) 00000100:00100000:3.0:1789351338.285817:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+12:13852:x1876270617042176:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 166us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351338.285823:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 92 00000100:00100000:0.0:1789351338.287477:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351338.287530:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617042304 00000100:00100000:3.0:1789351338.287539:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617042304 00000100:00100000:3.0:1789351338.287576:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:3.0:1789351338.287583:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+12:13852:x1876270617042304:12345-192.168.201.52@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789351338.287610:0:14278:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789351338.287637:0:14278:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789351338.287642:0:14278:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789351338.287646:0:14278:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789351338.287649:0:14278:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789351338.288763:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+12:13852:x1876270617042304:12345-192.168.201.52@tcp:256:mount.lustre.0 Request processed in 1172us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351338.288773:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 93 00000100:00100000:1.0:1789351338.294098:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351338.294205:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617042432 00000100:00100000:3.0:1789351338.294218:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617042432 00000100:00100000:3.0:1789351338.294295:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00100000:3.0:1789351338.294307:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+12:13852:x1876270617042432:12345-192.168.201.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789351338.294330:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351338.294402:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df800b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d80ee expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351338.294443:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df800b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d80ee expref: 13 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351338.294456:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df800b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d80ee expref: 13 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351338.294489:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c4a00, rc 0) 00000100:00100000:3.0:1789351338.294558:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6427e0e9-9c75-48a8-96a8-7276ecdd0115+13:13852:x1876270617042432:12345-192.168.201.52@tcp:101:mount.lustre.0 Request processed in 254us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351338.294567:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 94 00000100:00100000:0.0:1789351338.297087:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351338.297160:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617042560 00000100:00100000:3.0:1789351338.297174:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617042560 00000100:00100000:3.0:1789351338.297251:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 95 00000100:00100000:3.0:1789351338.297264:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+13:13852:x1876270617042560:12345-192.168.201.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789351338.297718:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+13:13852:x1876270617042560:12345-192.168.201.52@tcp:501:mount.lustre.0 Request processed in 454us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351338.297727:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 95 00000100:00100000:0.0:1789351338.298821:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351338.298913:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617042688 00000100:00100000:2.0:1789351338.298923:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617042688 00000100:00100000:2.0:1789351338.298973:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:2.0:1789351338.298984:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+13:13852:x1876270617042688:12345-192.168.201.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789351338.299275:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+13:13852:x1876270617042688:12345-192.168.201.52@tcp:503:mount.lustre.0 Request processed in 293us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351338.299283:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 96 00000100:00100000:1.0:1789351338.300497:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351338.300587:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617042816 00000100:00100000:3.0:1789351338.300596:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617042816 00000100:00100000:3.0:1789351338.300642:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:3.0:1789351338.300653:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+13:13864:x1876270617042816:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789351338.300921:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+13:13864:x1876270617042816:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 269us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351338.300929:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 97 00000100:00100000:0.0:1789351338.302427:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351338.302516:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617042944 00000100:00100000:2.0:1789351338.302524:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617042944 00000100:00100000:2.0:1789351338.302564:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 98 00000100:00100000:2.0:1789351338.302572:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+13:13864:x1876270617042944:12345-192.168.201.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789351338.302796:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+13:13864:x1876270617042944:12345-192.168.201.52@tcp:502:llog_process_th.0 Request processed in 223us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351338.302804:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 98 00000100:00100000:0.0:1789351338.311100:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351338.311178:0:16150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617043072 00000100:00100000:3.0:1789351338.311192:0:16150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617043072 00000100:00100000:3.0:1789351338.311441:0:16150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1789351338.311453:0:16150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2346:x1876270617043072:12345-192.168.201.52@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789351338.311496:0:16150:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 1704b0c7-86a0-46ac-bd08-d088e6e03fad@192.168.201.52@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:3.0:1789351338.311546:0:16150:0:(genops.c:1406:class_connect()) connect: client 1704b0c7-86a0-46ac-bd08-d088e6e03fad, cookie 0xa6ea017771df8012 00000004:00100000:3.0:1789351338.311587:0:16150:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789351338.311934:0:16150:0:(import.c:65:import_set_state_nolock()) ffff8d2bc26d3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789351338.312019:0:16150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1704b0c7-86a0-46ac-bd08-d088e6e03fad+6:2346:x1876270617043072:12345-192.168.201.52@tcp:38:mount.lustre.0 Request processed in 567us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351338.312028:0:16150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:1.0:1789351338.313245:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351338.313289:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351338.313318:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617043200 00000100:00100000:0.0:1789351338.313330:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617043200 00000100:00100000:3.0:1789351338.313342:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617043328 00000100:00100000:3.0:1789351338.313348:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617043328 00000100:00100000:3.0:1789351338.313414:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:3.0:1789351338.313426:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1704b0c7-86a0-46ac-bd08-d088e6e03fad+7:13852:x1876270617043328:12345-192.168.201.52@tcp:41:mount.lustre.0 00000100:00100000:0.0:1789351338.313427:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1789351338.313441:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1704b0c7-86a0-46ac-bd08-d088e6e03fad+7:0:x1876270617043200:12345-192.168.201.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789351338.313462:0:14283:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:0.0:1789351338.313462:0:14284:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1789351338.313525:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789351338.313575:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1704b0c7-86a0-46ac-bd08-d088e6e03fad+7:13852:x1876270617043328:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 152us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351338.313584:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:0.0:1789351338.313604:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1704b0c7-86a0-46ac-bd08-d088e6e03fad+6:0:x1876270617043200:12345-192.168.201.52@tcp:41:mount.lustre.0 Request processed in 164us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351338.313613:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1789351338.316106:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351338.316313:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617043456 00000100:00100000:3.0:1789351338.316323:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617043456 00000100:00100000:3.0:1789351338.316417:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:3.0:1789351338.316428:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1704b0c7-86a0-46ac-bd08-d088e6e03fad+6:13852:x1876270617043456:12345-192.168.201.52@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789351338.316539:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1704b0c7-86a0-46ac-bd08-d088e6e03fad+6:13852:x1876270617043456:12345-192.168.201.52@tcp:40:mount.lustre.0 Request processed in 113us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351338.316546:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:1.0:1789351338.322255:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351338.322317:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351338.322326:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617043584 00000100:00100000:3.0:1789351338.322339:0:14967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617043584 00000100:00100000:1.0:1789351338.322349:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351338.322417:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617043840 00000100:00100000:3.0:1789351338.322421:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617043712 00000100:00100000:2.0:1789351338.322424:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617043840 00000100:00100000:3.0:1789351338.322426:0:14967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617043712 00000100:00100000:3.0:1789351338.322454:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:3.0:1789351338.322467:0:14967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1876270617043584:12345-192.168.201.52@tcp:8:mount.lustre.0 00000100:00100000:2.0:1789351338.322502:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00010000:00080000:3.0:1789351338.322518:0:14967:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 1704b0c7-86a0-46ac-bd08-d088e6e03fad@192.168.201.52@tcp t0 exp 0000000000000000 cur 282 last 0 00000100:00100000:2.0:1789351338.322526:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1704b0c7-86a0-46ac-bd08-d088e6e03fad+6:13852:x1876270617043840:12345-192.168.201.52@tcp:33:mount.lustre.0 00000020:00000080:3.0:1789351338.322560:0:14967:0:(genops.c:1406:class_connect()) connect: client 1704b0c7-86a0-46ac-bd08-d088e6e03fad, cookie 0xa6ea017771df8019 00002000:00100000:3.0:1789351338.322576:0:14967:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1704b0c7-86a0-46ac-bd08-d088e6e03fad/ffff8d2bc26d1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789351338.322592:0:14967:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789351338.322655:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:1.0:1789351338.322662:0:14965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1876270617043712:12345-192.168.201.52@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789351338.322681:0:14965:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 1704b0c7-86a0-46ac-bd08-d088e6e03fad@192.168.201.52@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:1.0:1789351338.322713:0:14965:0:(genops.c:1406:class_connect()) connect: client 1704b0c7-86a0-46ac-bd08-d088e6e03fad, cookie 0xa6ea017771df8020 00002000:00100000:1.0:1789351338.322720:0:14965:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1704b0c7-86a0-46ac-bd08-d088e6e03fad/ffff8d2cc31aa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789351338.322723:0:14967:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00100000:1.0:1789351338.322729:0:14965:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789351338.322759:0:14967:0:(import.c:65:import_set_state_nolock()) ffff8d2bc26d4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789351338.322857:0:14967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1704b0c7-86a0-46ac-bd08-d088e6e03fad+6:2346:x1876270617043584:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 377us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351338.322867:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00000004:00200000:2.0:1789351338.322873:0:14287:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00002000:00080000:1.0:1789351338.322895:0:14965:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789351338.322914:0:14965:0:(import.c:65:import_set_state_nolock()) ffff8d2cffa6f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789351338.322945:0:14965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1704b0c7-86a0-46ac-bd08-d088e6e03fad+6:2346:x1876270617043712:12345-192.168.201.52@tcp:8:mount.lustre.0 Request processed in 282us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351338.322953:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:2.0:1789351338.323056:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1704b0c7-86a0-46ac-bd08-d088e6e03fad+6:13852:x1876270617043840:12345-192.168.201.52@tcp:33:mount.lustre.0 Request processed in 536us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351338.323064:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:1.0:1789351338.394840:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351338.394953:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617043968 00000100:00100000:3.0:1789351338.394968:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617043968 00000100:00100000:3.0:1789351338.395044:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:3.0:1789351338.395055:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1704b0c7-86a0-46ac-bd08-d088e6e03fad+6:13885:x1876270617043968:12345-192.168.201.52@tcp:101:mkdir.0 00010000:00010000:3.0:1789351338.395081:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351338.395107:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c5800/0xa6ea017771df8027 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8118 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351338.395182:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df802e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351338.395200:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df802e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351338.395215:0:14283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df802e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351338.395508:0:14283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789351338.395529:0:14283:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351338.395619:0:14283:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df802e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351338.395660:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c5800/0xa6ea017771df8027 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8118 expref: 8 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351338.395691:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df802e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8118 expref: 7 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351338.395702:0:14283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:3.0:1789351338.395705:0:14283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789351338.395710:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c4200, rc 0) 00000100:00100000:3.0:1789351338.395791:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1704b0c7-86a0-46ac-bd08-d088e6e03fad+7:13885:x1876270617043968:12345-192.168.201.52@tcp:101:mkdir.0 Request processed in 737us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351338.395799:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000001:00100000:1.0:1789351338.673477:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 53889ff8-25a9-4f06-adfc-5fffc69706fc 00000001:00100000:1.0:1789351338.673508:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1704b0c7-86a0-46ac-bd08-d088e6e03fad 00010000:00010000:3.0:1789351339.233558:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789351339.681737:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789351339.681770:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626457344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789351339.681875:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351339.681953:0:14969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626457344 00000100:00100000:3.0:1789351339.681964:0:14969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626457344 00000100:00080000:0.0:1789351339.682050:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789351339.682058:0:14969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789351339.682080:0:14969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626457344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789351339.682128:0:14969:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789351339.682199:0:14969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876270626457344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351339.682207:0:14969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789351339.682240:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626457344:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789351339.800229:0:16239:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789351340.257647:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789351341.281528:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789351341.667974:0:16387:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde5751100 20000000:00000080:1.0:1789351341.667998:0:16387:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2bc13bc800 uarg=0000000000000000 20000000:01000000:1.0:1789351341.668047:0:16387:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789351341.668055:0:16387:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789351341.668060:0:16387:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789351341.668946:0:16388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1789351341.669135:0:16387:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789351341.675280:0:16387:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789351341.675325:0:16387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2ceecc4400/0xa6ea017771df8035 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.675351:0:16387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cc3104e00/0xa6ea017771df7d2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7d25 expref: 18 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.675404:0:16387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2cc3104200/0xa6ea017771df7d79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7d72 expref: 18 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.675412:0:16387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d02045000/0xa6ea017771df7eb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df7ead expref: 18 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.675425:0:16387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d00bc0c00/0xa6ea017771df7f0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d808c expref: 12 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.675434:0:16387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df800b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d80ee expref: 12 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.675443:0:16387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2ceecc4400/0xa6ea017771df8035 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.675505:0:16387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df800b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d80ee expref: 12 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.675549:0:16387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df800b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d80ee expref: 12 pid: 14275 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351341.675570:0:16387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb66a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16387:1876270626457472:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351341.675719:0:16387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d00bc0c00/0xa6ea017771df7f0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d808c expref: 12 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.675729:0:16387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2d00bc0c00/0xa6ea017771df7f0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d808c expref: 12 pid: 14277 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351341.675739:0:16387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffb64700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16387:1876270626457600:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351341.675776:0:16387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d02045000/0xa6ea017771df7eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df7ead expref: 18 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.675785:0:16387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2d02045000/0xa6ea017771df7eb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df7ead expref: 18 pid: 14275 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351341.675807:0:16387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf725aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16387:1876270626457728:0@lo:104: 00000100:00100000:1.0:1789351341.675858:0:16387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789351341.675903:0:16387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cc3104200/0xa6ea017771df7d79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df7d72 expref: 18 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.675912:0:16387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2cc3104200/0xa6ea017771df7d79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df7d72 expref: 18 pid: 14278 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351341.675921:0:16387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7259880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16387:1876270626457856:0@lo:104: 00000100:00100000:1.0:1789351341.675944:0:16387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351341.676012:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626457728 00000100:00100000:1.0:1789351341.676021:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626457728 00000100:00100000:1.0:1789351341.676080:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626457856 00000100:00100000:1.0:1789351341.676084:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626457856 00000100:00100000:1.0:1789351341.676110:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789351341.676121:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+4:16387:x1876270626457728:12345-0@lo:104: 00010000:00010000:1.0:1789351341.676137:0:14266:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5800/0xa6ea017771df7ead lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df7eb4 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.676197:0:14266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789351341.676204:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+4:16387:x1876270626457728:12345-0@lo:104: Request processed in 85us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351341.676212:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789351341.676238:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789351341.676245:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7258a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+3:16387:x1876270626457856:12345-0@lo:104: 00010000:00010000:1.0:1789351341.676253:0:14266:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df7d72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df7d79 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351341.676262:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351341.676276:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5800/0xa6ea017771df7ead lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df7eb4 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351341.676283:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5800 already unused, calling callback (ffffffffc1cf8c20) 00010000:00010000:1.0:1789351341.676286:0:14266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:2.0:1789351341.676288:0:14271:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5800/0xa6ea017771df7ead lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df7eb4 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351341.676297:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7258a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+3:16387:x1876270626457856:12345-0@lo:104: Request processed in 50us (349us total) trans 0 rc 0/0 00010000:00010000:2.0:1789351341.676300:0:14271:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5800/0xa6ea017771df7ead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df7eb4 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351341.676308:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 10000000:00010000:2.0:1789351341.676312:0:14271:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5800/0xa6ea017771df7ead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df7eb4 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351341.676317:0:14271:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789351341.676349:0:14271:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5800/0xa6ea017771df7ead lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7eb4 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.676349:0:16387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2cc3104e00/0xa6ea017771df7d2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6ea017771df7d25 expref: 18 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351341.676382:0:14271:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789351341.676390:0:16387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2cc3104e00/0xa6ea017771df7d2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6ea017771df7d25 expref: 18 pid: 14278 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351341.676401:0:16387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf7258700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16387:1876270626457984:0@lo:104: 00010000:00010000:2.0:1789351341.676431:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5800/0xa6ea017771df7ead lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7eb4 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351341.676441:0:16387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789351341.676446:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5800/0xa6ea017771df7ead lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7eb4 expref: -99 pid: 15681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351341.676480:0:14266:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789351341.676492:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626457984 00000100:00100000:1.0:1789351341.676495:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626457984 00000100:00100000:1.0:1789351341.676514:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789351341.676521:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cff96ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+3:16387:x1876270626457984:12345-0@lo:104: 00010000:00010000:1.0:1789351341.676535:0:14266:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5e00/0xa6ea017771df7d25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df7d2c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351341.676543:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351341.676547:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df7d72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df7d79 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351341.676551:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8a00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:2.0:1789351341.676554:0:14271:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df7d72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df7d79 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351341.676560:0:14271:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df7d72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df7d79 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789351341.676564:0:14271:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df7d72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df7d79 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351341.676568:0:14271:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789351341.676568:0:14266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789351341.676578:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cff96ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+3:16387:x1876270626457984:12345-0@lo:104: Request processed in 57us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351341.676586:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789351341.676590:0:14271:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df7d72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7d79 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351341.676598:0:14271:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789351341.676605:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df7d72 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7d79 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351341.676613:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2ceecd8a00/0xa6ea017771df7d72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7d79 expref: -99 pid: 14963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351341.676624:0:14271:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789351341.676628:0:14271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5e00/0xa6ea017771df7d25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6ea017771df7d2c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351341.676640:0:14271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5e00 already unused, calling callback (ffffffffc1cf8c20) 10000000:00010000:2.0:1789351341.676642:0:14271:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5e00/0xa6ea017771df7d25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6ea017771df7d2c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351341.676644:0:16387:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2ce02ff300 going to sleep for 11 seconds 00010000:00010000:2.0:1789351341.676651:0:14271:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5e00/0xa6ea017771df7d25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6ea017771df7d2c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789351341.676656:0:14271:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5e00/0xa6ea017771df7d25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6ea017771df7d2c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351341.676660:0:14271:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789351341.676670:0:14271:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5e00/0xa6ea017771df7d25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7d2c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351341.676674:0:16387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf725aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16387:1876270626457728:0@lo:104: 00010000:00010000:2.0:1789351341.676675:0:14271:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789351341.676690:0:16387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7259880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16387:1876270626457856:0@lo:104: 00010000:00010000:2.0:1789351341.676691:0:14271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5e00/0xa6ea017771df7d25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7d2c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351341.676700:0:14271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5e00/0xa6ea017771df7d25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6ea017771df7d2c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351341.676704:0:16387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf7258700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16387:1876270626457984:0@lo:104: 00010000:00010000:2.0:1789351341.676716:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351341.676718:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789351341.676720:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789351341.676739:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3288:1876270626458112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789351341.676751:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3286:1876270626458368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789351341.676768:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351341.676789:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789351341.676917:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351341.677236:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626458112 00000100:00100000:1.0:1789351341.677241:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626458112 00010000:00010000:1.0:1789351341.677261:0:14269:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d02045000/0xa6ea017771df7eb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df7ead expref: 19 pid: 14275 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351341.677273:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789351341.677283:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626458368 00000100:00100000:2.0:1789351341.677284:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3288:1876270626458240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789351341.677289:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626458368 00010000:00010000:1.0:1789351341.677304:0:14269:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cc3104e00/0xa6ea017771df7d2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df7d25 expref: 20 pid: 14278 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351341.677320:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351341.677338:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626458240 00000100:00100000:1.0:1789351341.677342:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626458240 00010000:00010000:1.0:1789351341.677385:0:14269:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2cc3104200/0xa6ea017771df7d79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df7d72 expref: 21 pid: 14278 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351341.677401:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789351341.677409:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+21:3288:x1876270626458112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351341.677421:0:14269:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351341.677427:0:14269:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d02045000/0xa6ea017771df7eb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df7ead expref: 21 pid: 14275 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.677437:0:14269:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d02045000/0xa6ea017771df7eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df7ead expref: 21 pid: 14275 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.677452:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d02045000/0xa6ea017771df7eb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df7ead expref: 21 pid: 14275 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.677469:0:14269:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351341.677504:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+20:3288:x1876270626458112:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351341.677510:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789351341.677525:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789351341.677531:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:3286:x1876270626458368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351341.677539:0:14269:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351341.677544:0:14269:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cc3104e00/0xa6ea017771df7d2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df7d25 expref: 19 pid: 14278 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.677552:0:14269:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cc3104e00/0xa6ea017771df7d2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df7d25 expref: 19 pid: 14278 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.677571:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cc3104e00/0xa6ea017771df7d2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df7d25 expref: 19 pid: 14278 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.677580:0:14269:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351341.677608:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:3286:x1876270626458368:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351341.677615:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789351341.677628:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789351341.677634:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf6952050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:3288:x1876270626458240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789351341.677642:0:14269:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351341.677646:0:14269:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2cc3104200/0xa6ea017771df7d79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6ea017771df7d72 expref: 17 pid: 14278 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.677654:0:14269:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2cc3104200/0xa6ea017771df7d79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6ea017771df7d72 expref: 17 pid: 14278 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.677663:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2cc3104200/0xa6ea017771df7d79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6ea017771df7d72 expref: 17 pid: 14278 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.677672:0:14269:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351341.677691:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf6952050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:3288:x1876270626458240:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351341.677698:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789351341.677750:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3286:1876270626458368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789351341.677844:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3288:1876270626458240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789351341.677852:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:3288:1876270626458112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789351341.678121:0:16387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb66a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16387:1876270626457472:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789351341.678603:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351341.678673:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617044096 00000100:00100000:1.0:1789351341.678679:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617044096 00010000:00010000:1.0:1789351341.678701:0:14269:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df800b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d80ee expref: 13 pid: 14275 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351341.678765:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:1.0:1789351341.678774:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+13:2348:x1876270617044096:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789351341.678784:0:14269:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789351341.678788:0:14269:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df800b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d80ee expref: 13 pid: 14275 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.678812:0:14269:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df800b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d80ee expref: 13 pid: 14275 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.678825:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df800b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d80ee expref: 13 pid: 14275 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351341.678836:0:14269:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789351341.678918:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+12:2348:x1876270617044096:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 145us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351341.678925:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:2.0:1789351341.679233:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351341.679294:0:14270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617044224 00000100:00100000:0.0:1789351341.679298:0:14270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617044224 00010000:00010000:0.0:1789351341.679317:0:14270:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d00bc0c00/0xa6ea017771df7f0f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d808c expref: 12 pid: 14277 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351341.679344:0:14270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:0.0:1789351341.679351:0:14270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffadad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+12:2347:x1876270617044224:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351341.679380:0:14270:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351341.679392:0:14270:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d00bc0c00/0xa6ea017771df7f0f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d808c expref: 12 pid: 14277 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351341.679403:0:14270:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d00bc0c00/0xa6ea017771df7f0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d808c expref: 12 pid: 14277 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351341.679416:0:14270:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2ceecc4400/0xa6ea017771df8035 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351341.679426:0:14270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ceecc4400/0xa6ea017771df8035 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351341.679442:0:14270:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2ceecc4400/0xa6ea017771df8035 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351341.679449:0:14270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2ceecc4400/0xa6ea017771df8035 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351341.679456:0:14270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2ceecc4400/0xa6ea017771df8035 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351341.679463:0:14270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2ceecc4400/0xa6ea017771df8035 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351341.679470:0:14270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4400 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351341.679474:0:14270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2ceecc4400/0xa6ea017771df8035 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351341.679484:0:14270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2ceecc4400/0xa6ea017771df8035 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351341.679491:0:14270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2ceecc4400/0xa6ea017771df8035 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351341.679508:0:14270:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351341.679538:0:14270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffadad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+12:2347:x1876270617044224:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 188us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351341.679545:0:14270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00010000:00010000:3.0:1789351341.679930:0:16387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d00bc0c00/0xa6ea017771df7f0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d808c expref: 11 pid: 14277 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351341.679951:0:16387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffb64700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16387:1876270626457600:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351341.679995:0:16387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2ceecc4400/0xa6ea017771df8035 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351341.680006:0:16387:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2ceecc4400/0xa6ea017771df8035 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351341.680013:0:16387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2ceecc4400/0xa6ea017771df8035 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351341.680019:0:16387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ceecc4400/0xa6ea017771df8035 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351342.241638:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626458496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789351342.241744:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351342.241839:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876270626459008:0@lo:400:kworker.0 00000100:00100000:2.0:1789351342.241875:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351342.241911:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789351342.241919:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876270626458880:0@lo:400:kworker.0 00000100:00100000:0.0:1789351342.241942:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626459008 00000100:00100000:2.0:1789351342.241951:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351342.241954:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626459008 00000100:00080000:0.0:1789351342.242049:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789351342.242060:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626458880 00000100:00100000:0.0:1789351342.242064:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626458880 00000100:00100000:0.0:1789351342.242106:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789351342.242112:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626458624:0@lo:400:kworker.0 00000100:00100000:0.0:1789351342.242120:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876270626459008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351342.242148:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789351342.242154:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789351342.242161:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876270626458880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351342.242184:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626459136:0@lo:400:kworker.0 00000100:00100000:0.0:1789351342.242196:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876270626459008:12345-0@lo:400:kworker.0 Request processed in 80us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351342.242198:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876270626458880:12345-0@lo:400:kworker.0 Request processed in 41us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351342.242206:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789351342.242218:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351342.242220:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789351342.242226:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626459136 00000100:00100000:3.0:1789351342.242229:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626459136 00000100:00100000:2.0:1789351342.242240:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789351342.242248:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626458752:0@lo:400:kworker.0 00000100:00100000:3.0:1789351342.242268:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789351342.242279:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876270626459136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789351342.242282:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351342.242336:0:14969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626458496 00000100:00100000:2.0:1789351342.242341:0:14969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626458496 00000100:00100000:2.0:1789351342.242409:0:14969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789351342.242419:0:14969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626458496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789351342.242451:0:14969:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789351342.242681:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876270626459136:12345-0@lo:400:kworker.0 Request processed in 404us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351342.242689:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789351342.242714:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626458624 00000100:00100000:3.0:1789351342.242717:0:14967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626458624 00000100:00100000:3.0:1789351342.243068:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626458752 00000100:00100000:3.0:1789351342.243073:0:14967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626458752 00000100:00100000:3.0:1789351342.243101:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789351342.243108:0:14967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626458624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351342.243146:0:14967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626458624:12345-0@lo:400:kworker.0 Request processed in 39us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351342.243152:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789351342.243165:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789351342.243172:0:14967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626458752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789351342.243204:0:14967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626458752:12345-0@lo:400:kworker.0 Request processed in 33us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351342.243211:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789351342.243234:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789351342.243238:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789351342.243241:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789351342.243296:0:3288:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000004:00080000:2.0:1789351342.243303:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2ceee15180, transno 8589934593 00000100:00100000:2.0:1789351342.243400:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626458752:0@lo:400:kworker.0 00000100:00100000:2.0:1789351342.243425:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626458624:0@lo:400:kworker.0 00000100:00100000:2.0:1789351342.243438:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876270626459136:0@lo:400:kworker.0 00000100:00100000:2.0:1789351342.243486:0:14969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876270626458496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1070us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351342.243495:0:14969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789351342.243594:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876270626458880:0@lo:400:kworker.0 00000100:00100000:2.0:1789351342.243607:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876270626459008:0@lo:400:kworker.0 00000100:00100000:2.0:1789351342.243624:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876270626458496:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1789351342.246613:0:14307:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 1, last_idx 2 00000040:00080000:1.0:1789351342.246669:0:14307:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:00100000:2.0:1789351342.261061:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1704b0c7-86a0-46ac-bd08-d088e6e03fad 00000001:00100000:3.0:1789351342.264317:0:7616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1704b0c7-86a0-46ac-bd08-d088e6e03fad 00010000:00010000:0.0:1789351342.308068:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789351343.267213:0:14280:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789351343.267224:0:14280:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2bc3740000 from 10 10000000:01000000:2.0:1789351343.267230:0:14280:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789351343.267289:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1200/0xa6ea017771df803c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.267302:0:14280:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1200/0xa6ea017771df803c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.267315:0:14280:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1200/0xa6ea017771df803c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351343.267344:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626459264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789351343.267478:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351343.267572:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd819d180 going to sleep for 11 seconds 00000100:00100000:3.0:1789351343.268734:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626459264 00000100:00100000:3.0:1789351343.268746:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626459264 00000100:00100000:3.0:1789351343.268815:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789351343.268826:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+16:14280:x1876270626459264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789351343.268843:0:14278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351343.268862:0:14278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d021c5e00/0xa6ea017771df8043 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df803c expref: -99 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.268891:0:14278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d021c5e00/0xa6ea017771df8043 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df803c expref: 17 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.268902:0:14278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d021c5e00/0xa6ea017771df8043 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df803c expref: 17 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.268920:0:14278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c5e00, rc 0) 00000100:00100000:3.0:1789351343.268983:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:14280:x1876270626459264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351343.268990:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789351343.269184:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626459264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789351343.269201:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1200/0xa6ea017771df803c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df8043 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.269210:0:14280:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1200/0xa6ea017771df803c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df8043 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351343.269274:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626459392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789351343.269307:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351343.269341:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd819d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789351343.269409:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626459392 00000100:00100000:0.0:1789351343.269415:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626459392 00000100:00100000:0.0:1789351343.269454:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789351343.269461:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:14280:x1876270626459392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351343.269658:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:14280:x1876270626459392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351343.269663:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789351343.269723:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626459392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351343.269749:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf725bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626459520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789351343.269796:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351343.269819:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351343.270098:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626459520 00000100:00100000:3.0:1789351343.270104:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626459520 00000100:00100000:3.0:1789351343.270141:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789351343.270149:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:14280:x1876270626459520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789351343.270389:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:14280:x1876270626459520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351343.270397:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789351343.274691:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf725bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626459520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789351343.276307:0:16498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789351343.276586:0:14280:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789351343.276623:0:14280:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789351343.276634:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1200/0xa6ea017771df803c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df8043 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.276645:0:14280:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc1200/0xa6ea017771df803c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df8043 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789351343.276656:0:14280:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789351343.276658:0:14280:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2bc13e0800 from 10 10000000:01000000:2.0:1789351343.276660:0:14280:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789351343.276698:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0c00/0xa6ea017771df804a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.276707:0:14280:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0c00/0xa6ea017771df804a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.276719:0:14280:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0c00/0xa6ea017771df804a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351343.276762:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626459648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789351343.276836:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351343.276883:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd819df00 going to sleep for 11 seconds 00000100:00100000:3.0:1789351343.277032:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626459648 00000100:00100000:3.0:1789351343.277042:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626459648 00000100:00100000:3.0:1789351343.277093:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789351343.277104:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+17:14280:x1876270626459648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789351343.277118:0:14278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351343.277136:0:14278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d021c5800/0xa6ea017771df8051 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df804a expref: -99 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.277158:0:14278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d021c5800/0xa6ea017771df8051 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df804a expref: 18 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.277169:0:14278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d021c5800/0xa6ea017771df8051 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df804a expref: 18 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.277177:0:14278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c5800, rc 0) 00000100:00100000:3.0:1789351343.277229:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:14280:x1876270626459648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351343.277236:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789351343.277450:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626459648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789351343.277463:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0c00/0xa6ea017771df804a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df8051 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.277472:0:14280:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0c00/0xa6ea017771df804a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df8051 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351343.277518:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626459776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789351343.277543:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351343.277559:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd819df00 going to sleep for 11 seconds 00000100:00100000:0.0:1789351343.277630:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626459776 00000100:00100000:0.0:1789351343.277635:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626459776 00000100:00100000:0.0:1789351343.277668:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789351343.277676:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:14280:x1876270626459776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351343.277958:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:14280:x1876270626459776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351343.277965:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789351343.278165:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626459776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789351343.278193:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626459904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789351343.278227:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789351343.278245:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd819df00 going to sleep for 11 seconds 00000100:00100000:3.0:1789351343.278300:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626459904 00000100:00100000:3.0:1789351343.278304:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626459904 00000100:00100000:3.0:1789351343.278323:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789351343.278328:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:14280:x1876270626459904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789351343.278516:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:14280:x1876270626459904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351343.278522:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789351343.278785:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626459904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789351343.281942:0:16499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789351343.282250:0:14280:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789351343.282281:0:14280:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789351343.282294:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0c00/0xa6ea017771df804a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df8051 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351343.282305:0:14280:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2d00bc0c00/0xa6ea017771df804a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df8051 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789351343.282316:0:14280:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789351343.282319:0:14280:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d2cffaea000 from 10 10000000:01000000:1.0:1789351343.282322:0:14280:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789351343.282424:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5200/0xa6ea017771df8058 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351343.282433:0:14280:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5200/0xa6ea017771df8058 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351343.282446:0:14280:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5200/0xa6ea017771df8058 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351343.282470:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf725bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626460032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789351343.282537:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351343.282732:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351343.282915:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626460032 00000100:00100000:3.0:1789351343.282924:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626460032 00000100:00100000:3.0:1789351343.283096:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789351343.283107:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+18:14280:x1876270626460032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789351343.283120:0:14278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351343.283134:0:14278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d021c5c00/0xa6ea017771df805f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6ea017771df8058 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.283162:0:14278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d021c5c00/0xa6ea017771df805f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6ea017771df8058 expref: 19 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.283174:0:14278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d021c5c00/0xa6ea017771df805f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6ea017771df8058 expref: 19 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.283182:0:14278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c5c00, rc 0) 00000100:00100000:3.0:1789351343.283234:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:14280:x1876270626460032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351343.283241:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789351343.283321:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf725bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626460032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789351343.283338:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5200/0xa6ea017771df8058 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df805f expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351343.283346:0:14280:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5200/0xa6ea017771df8058 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6ea017771df805f expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351343.283435:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cf725bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626460160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789351343.283469:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351343.284292:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789351343.284516:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626460160 00000100:00100000:0.0:1789351343.284523:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626460160 00000100:00100000:0.0:1789351343.284555:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789351343.284564:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:14280:x1876270626460160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351343.285277:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:14280:x1876270626460160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 711us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351343.285285:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789351343.285435:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cf725bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626460160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351343.285537:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626460288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789351343.285580:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789351343.285796:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6112240 going to sleep for 11 seconds 00000100:00100000:3.0:1789351343.285849:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626460288 00000100:00100000:3.0:1789351343.285854:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626460288 00000100:00100000:3.0:1789351343.285880:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789351343.285887:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:14280:x1876270626460288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789351343.286196:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de+19:14280:x1876270626460288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 308us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351343.286203:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789351343.286265:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd22e09-e0b6-4924-ac9c-e7bebc9b89de:14280:1876270626460288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789351343.287787:0:16500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789351343.287955:0:14280:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789351343.287982:0:14280:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789351343.287993:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5200/0xa6ea017771df8058 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df805f expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.288086:0:14280:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.152@tcp lock: ffff8d2ceecc5200/0xa6ea017771df8058 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6ea017771df805f expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.329525:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789351343.337787:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351343.337898:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617044352 00000100:00100000:0.0:1789351343.337911:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617044352 00000100:00100000:0.0:1789351343.337986:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 108 00000100:00100000:0.0:1789351343.337998:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+11:13738:x1876270617044352:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789351343.338016:0:14277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351343.338035:0:14277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d02045a00/0xa6ea017771df8066 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d811f expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.338065:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d02045a00/0xa6ea017771df8066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d811f expref: 12 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.338094:0:14277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d02045a00/0xa6ea017771df8066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d811f expref: 12 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.338105:0:14277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d02045a00, rc 0) 00000100:00100000:0.0:1789351343.338261:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+12:13738:x1876270617044352:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 265us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351343.338270:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 108 00000100:00100000:0.0:1789351343.346656:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351343.346755:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617044480 00000100:00100000:3.0:1789351343.346776:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617044480 00000100:00100000:3.0:1789351343.346837:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:3.0:1789351343.346847:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+12:13738:x1876270617044480:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789351343.347279:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+12:13738:x1876270617044480:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 431us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351343.347289:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 109 00000100:00100000:1.0:1789351343.357547:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351343.358064:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617044608 00000100:00100000:0.0:1789351343.358087:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617044608 00000100:00100000:0.0:1789351343.358167:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:0.0:1789351343.358179:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+12:13738:x1876270617044608:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789351343.359976:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+12:13738:x1876270617044608:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 1784us (2430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351343.359992:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 110 00000100:00100000:1.0:1789351343.372451:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351343.373100:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617044736 00000100:00100000:3.0:1789351343.373113:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617044736 00000100:00100000:3.0:1789351343.373173:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00100000:3.0:1789351343.373185:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+12:13738:x1876270617044736:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789351343.373206:0:14278:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351343.373227:0:14278:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df806d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8126 expref: -99 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.373257:0:14278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df806d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8126 expref: 13 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.373271:0:14278:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d021c4a00/0xa6ea017771df806d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8126 expref: 13 pid: 14278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.373293:0:14278:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c4a00, rc 0) 00000100:00100000:3.0:1789351343.373436:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+13:13738:x1876270617044736:12345-192.168.201.52@tcp:101:ll_cfg_requeue.0 Request processed in 252us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351343.373446:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 111 00000100:00100000:2.0:1789351343.379114:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351343.380907:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617044864 00000100:00100000:0.0:1789351343.380929:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617044864 00000100:00100000:0.0:1789351343.381038:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:0.0:1789351343.381054:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+13:13738:x1876270617044864:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789351343.381583:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6427e0e9-9c75-48a8-96a8-7276ecdd0115+13:13738:x1876270617044864:12345-192.168.201.52@tcp:501:ll_cfg_requeue.0 Request processed in 531us (2478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351343.381593:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:1.0:1789351343.383283:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351343.383410:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617044992 00000100:00100000:3.0:1789351343.383427:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617044992 00000100:00100000:2.0:1789351343.383563:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 113 00000100:00100000:2.0:1789351343.383578:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf735e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+13:13738:x1876270617044992:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789351343.383880:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf735e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6427e0e9-9c75-48a8-96a8-7276ecdd0115+13:13738:x1876270617044992:12345-192.168.201.52@tcp:503:ll_cfg_requeue.0 Request processed in 304us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351343.383889:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 113 00000100:00100000:1.0:1789351343.532009:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351343.532049:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351343.532068:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351343.532108:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351343.532139:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351343.532158:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617045376 00000100:00100000:1.0:1789351343.532169:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351343.532173:0:14967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617045376 00000100:00100000:1.0:1789351343.532210:0:16150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617045120 00000100:00100000:1.0:1789351343.532223:0:16150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617045120 00000100:00100000:3.0:1789351343.532246:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617045632 00000100:00100000:3.0:1789351343.532249:0:14967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617045632 00000100:00100000:3.0:1789351343.532268:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617045248 00000100:00100000:3.0:1789351343.532270:0:14967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617045248 00000100:00100000:3.0:1789351343.532284:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617045760 00000100:00100000:3.0:1789351343.532287:0:14967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617045760 00000100:00100000:1.0:1789351343.532299:0:16150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617045504 00000100:00100000:1.0:1789351343.532305:0:16150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617045504 00000100:00100000:3.0:1789351343.532316:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:3.0:1789351343.532332:0:14967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+5:2348:x1876270617045376:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1789351343.532341:0:16150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:1.0:1789351343.532397:0:16150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:2348:x1876270617045120:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351343.532484:0:14967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+5:2348:x1876270617045376:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 154us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351343.532493:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:3.0:1789351343.532521:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:3.0:1789351343.532530:0:14967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1704b0c7-86a0-46ac-bd08-d088e6e03fad+5:2348:x1876270617045632:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1789351343.532552:0:14966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:2.0:1789351343.532568:0:14966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+5:2348:x1876270617045248:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1789351343.532634:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:0.0:1789351343.532649:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1704b0c7-86a0-46ac-bd08-d088e6e03fad+6:2348:x1876270617045504:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351343.533520:0:14967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1704b0c7-86a0-46ac-bd08-d088e6e03fad+5:2348:x1876270617045632:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 985us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351343.533523:0:16150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:2348:x1876270617045120:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 1161us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351343.533544:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:1.0:1789351343.533551:0:16150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:3.0:1789351343.533574:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:3.0:1789351343.533586:0:14967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1704b0c7-86a0-46ac-bd08-d088e6e03fad+5:2348:x1876270617045760:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1789351343.533636:0:14967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1704b0c7-86a0-46ac-bd08-d088e6e03fad+5:2348:x1876270617045760:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 50us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351343.533644:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00080000:3.0:1789351343.533674:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789351343.533681:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789351343.533685:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789351343.535819:0:14966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+5:2348:x1876270617045248:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 3242us (3695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351343.535835:0:14966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:0.0:1789351343.535935:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1704b0c7-86a0-46ac-bd08-d088e6e03fad+6:2348:x1876270617045504:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 3281us (3787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351343.535952:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:1.0:1789351343.567486:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351343.568880:0:16150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617045888 00000100:00100000:2.0:1789351343.568897:0:16150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617045888 00000100:00100000:2.0:1789351343.568982:0:16150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:2.0:1789351343.568993:0:16150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:14394:x1876270617045888:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789351343.569016:0:16150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351343.569044:0:16150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df8074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d812d expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569114:0:16150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df807b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569145:0:16150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df807b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569159:0:16150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df807b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569173:0:16150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df8082 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569180:0:16150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df8082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569186:0:16150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df8082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569683:0:16150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df8089 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569693:0:16150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df8089 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569700:0:16150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df8089 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351343.569799:0:16150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1789351343.569804:0:16150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351343.569896:0:16150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df8089 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569910:0:16150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df807b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569925:0:16150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df807b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569933:0:16150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df807b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569939:0:16150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351343.569942:0:16150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df807b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569950:0:16150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df807b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569963:0:16150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:2.0:1789351343.569966:0:16150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351343.569971:0:16150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df807b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569977:0:16150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df807b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569991:0:16150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df8082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.569996:0:16150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df8082 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.570002:0:16150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df8082 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.570007:0:16150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351343.570015:0:16150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df8082 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.570022:0:16150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df8082 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.570029:0:16150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d2ce9e1a800) 00010000:00010000:2.0:1789351343.570032:0:16150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351343.570035:0:16150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df8082 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.570040:0:16150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df8082 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.570074:0:16150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df8074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d812d expref: 8 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.570087:0:16150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0800/0xa6ea017771df8089 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d812d expref: 7 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.570094:0:16150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2ce9e1a200) 00010000:00010000:2.0:1789351343.570096:0:16150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789351343.570099:0:16150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0800, rc 0) 00000100:00100000:2.0:1789351343.570177:0:16150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+7:14394:x1876270617045888:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1185us (2705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351343.570184:0:16150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:1.0:1789351343.572082:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351343.572139:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617046144 00000100:00100000:0.0:1789351343.572166:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617046144 00000100:00100000:0.0:1789351343.572271:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:0.0:1789351343.572285:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+7:14394:x1876270617046144:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789351343.572311:0:14284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789351343.572337:0:14284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045e00/0xa6ea017771df8090 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8134 expref: -99 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.572440:0:14284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045800/0xa6ea017771df8097 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.572454:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045800/0xa6ea017771df8097 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.572465:0:14284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045800/0xa6ea017771df8097 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.573415:0:14284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df809e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.573434:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df809e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.573445:0:14284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df809e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.575511:0:14284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044c00/0xa6ea017771df80a5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.575531:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044c00/0xa6ea017771df80a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.575540:0:14284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044c00/0xa6ea017771df80a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789351343.575553:0:14284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789351343.575893:0:14284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045800/0xa6ea017771df8097 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.575901:0:14284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045800/0xa6ea017771df8097 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.575908:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045800/0xa6ea017771df8097 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.575914:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02045800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351343.575919:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045800/0xa6ea017771df8097 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.575927:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045800/0xa6ea017771df8097 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.575940:0:14284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2ce9e1a200) 00010000:00010000:0.0:1789351343.575942:0:14284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351343.575946:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045800/0xa6ea017771df8097 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.575954:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045800/0xa6ea017771df8097 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.575967:0:14284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df809e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.575979:0:14284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df809e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.575986:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df809e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.575991:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02044200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351343.575994:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df809e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.576000:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df809e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.576008:0:14284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d2cd9e27600) 00010000:00010000:0.0:1789351343.576011:0:14284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351343.576013:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df809e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.576018:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df809e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.577110:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045e00/0xa6ea017771df8090 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8134 expref: 10 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.577134:0:14284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044c00/0xa6ea017771df80a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8134 expref: 9 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.577142:0:14284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2cd9e27e00) 00010000:00010000:0.0:1789351343.577145:0:14284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351343.577154:0:14284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d02044c00, rc 0) 00000100:00100000:0.0:1789351343.577265:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+9:14394:x1876270617046144:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 4982us (5195us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789351343.577275:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 16 00000100:00100000:1.0:1789351343.581741:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351343.581839:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617046272 00000100:00100000:3.0:1789351343.582262:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617046272 00000100:00100000:3.0:1789351343.582347:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:3.0:1789351343.582407:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+9:14394:x1876270617046272:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789351343.582579:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+9:14394:x1876270617046272:12345-192.168.201.52@tcp:59:lhsmtool_posix.0 Request processed in 220us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351343.582588:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000040:00080000:0.0:1789351343.588031:0:14315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789351343.601961:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351343.602229:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617046400 00000100:00100000:3.0:1789351343.602251:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617046400 00000100:00100000:3.0:1789351343.602342:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:3.0:1789351343.602389:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+9:14400:x1876270617046400:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351343.602419:0:14285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351343.602447:0:14285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4c00/0xa6ea017771df80b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d813b expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.602534:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8a00/0xa6ea017771df80ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.602551:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8a00/0xa6ea017771df80ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.602566:0:14285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8a00/0xa6ea017771df80ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.602816:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df80c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.602825:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df80c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.602833:0:14285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df80c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603339:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8a00/0xa6ea017771df80ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603349:0:14285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8a00/0xa6ea017771df80ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603379:0:14285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8a00/0xa6ea017771df80ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603387:0:14285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351343.603392:0:14285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8a00/0xa6ea017771df80ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603401:0:14285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8a00/0xa6ea017771df80ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603416:0:14285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:3.0:1789351343.603420:0:14285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351343.603426:0:14285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8a00/0xa6ea017771df80ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603432:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8a00/0xa6ea017771df80ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603453:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df80c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603460:0:14285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df80c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603466:0:14285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df80c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603472:0:14285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351343.603475:0:14285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df80c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603481:0:14285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df80c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603490:0:14285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d2ce0439400) 00010000:00010000:3.0:1789351343.603492:0:14285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351343.603495:0:14285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df80c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603502:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df80c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603541:0:14285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4c00/0xa6ea017771df80b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d813b expref: 10 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603554:0:14285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:3.0:1789351343.603557:0:14285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351343.603566:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4c00/0xa6ea017771df80b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d813b expref: 10 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.603578:0:14285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d021c4c00, rc 0) 00000100:00100000:3.0:1789351343.603824:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+9:14400:x1876270617046400:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1469us (1877us total) trans 0 rc 301/301 00000100:00100000:3.0:1789351343.603833:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:1.0:1789351343.611121:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351343.611267:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617046528 00000100:00100000:2.0:1789351343.611284:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617046528 00000100:00100000:2.0:1789351343.611394:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:2.0:1789351343.611407:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:53889ff8-25a9-4f06-adfc-5fffc69706fc+9:14400:x1876270617046528:12345-192.168.201.52@tcp:700:lfs.0 00000100:00100000:2.0:1789351343.611537:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:53889ff8-25a9-4f06-adfc-5fffc69706fc+9:14400:x1876270617046528:12345-192.168.201.52@tcp:700:lfs.0 Request processed in 133us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351343.611545:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:1.0:1789351343.614590:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351343.614729:0:16150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617046784 00000100:00100000:2.0:1789351343.614745:0:16150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617046784 00000100:00100000:2.0:1789351343.614820:0:16150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:2.0:1789351343.614833:0:16150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+9:14400:x1876270617046784:12345-192.168.201.52@tcp:36:lfs.0 00010000:00010000:2.0:1789351343.614888:0:16150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351343.614913:0:16150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df7f32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d80b6 expref: 9 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.614933:0:16150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:2.0:1789351343.614938:0:16150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351343.615836:0:16150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df80c8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.615855:0:16150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df802e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8118 expref: 5 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.615864:0:16150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df80c8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.615900:0:16150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df802e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8118 expref: 5 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.615915:0:16150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df802e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8118 expref: 5 pid: 14283 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351343.615944:0:16150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16150:1876270626460416:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351343.616048:0:16150:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd819dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789351343.617740:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351343.618028:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617046912 00000100:00100000:3.0:1789351343.618041:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617046912 00010000:00010000:3.0:1789351343.618111:0:14269:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df802e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8118 expref: 6 pid: 14283 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351343.618173:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:3.0:1789351343.618193:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1704b0c7-86a0-46ac-bd08-d088e6e03fad+6:2347:x1876270617046912:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351343.618214:0:14269:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351343.618222:0:14269:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df802e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8118 expref: 6 pid: 14283 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.618243:0:14269:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df802e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8118 expref: 6 pid: 14283 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.618276:0:14269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:3.0:1789351343.618283:0:14269:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df80c8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.618296:0:14269:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df80c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.618306:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df80c8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.618353:0:14269:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351343.618464:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1704b0c7-86a0-46ac-bd08-d088e6e03fad+6:2347:x1876270617046912:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 276us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351343.618477:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00010000:00010000:2.0:1789351343.623935:0:16150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d021c4200/0xa6ea017771df802e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8118 expref: 5 pid: 14283 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351343.623982:0:16150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16150:1876270626460416:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351343.624013:0:16150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df80c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.624022:0:16150:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df80c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.624028:0:16150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df80c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.624059:0:16150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df80cf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.624073:0:16150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df80cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.624085:0:16150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df80cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351343.625657:0:16150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789351343.625673:0:16150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df80c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.625682:0:16150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df80c8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.625696:0:16150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df80c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.625702:0:16150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351343.625707:0:16150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df80c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.625715:0:16150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df80c8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.625730:0:16150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cc3d1c100) 00010000:00010000:2.0:1789351343.625733:0:16150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351343.625738:0:16150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df80c8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.625745:0:16150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df80c8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789351343.625777:0:16150:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058915182 reply state 00000000ce30ff3c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df80cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351343.625786:0:16150:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789351343.625893:0:16150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+10:14400:x1876270617046784:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 11059us (11321us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789351343.625903:0:16150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00010000:00010000:2.0:1789351343.631038:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df80cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.631064:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df80cf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.631258:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df80cf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.631266:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351343.631272:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df80cf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.631281:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df80cf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.631303:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d2ce9e1a800) 00010000:00010000:2.0:1789351343.631306:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351343.631312:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df80cf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.631408:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df80cf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351343.674834:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351343.674994:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617047040 00000100:00100000:0.0:1789351343.675007:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617047040 00000100:00100000:0.0:1789351343.675079:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:0.0:1789351343.675091:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+9:14408:x1876270617047040:12345-192.168.201.52@tcp:101:lctl.0 00010000:00010000:0.0:1789351343.675123:0:14284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351343.676851:0:14284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045e00/0xa6ea017771df80d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8142 expref: -99 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351343.676973:0:14284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df80dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351343.676992:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df80dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351343.677008:0:14284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df80dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789351343.677105:0:14284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789351343.677110:0:14284:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1789351343.677179:0:14284:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df80dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351343.677212:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045e00/0xa6ea017771df80d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8142 expref: 11 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351343.677250:0:14284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5e00/0xa6ea017771df80dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8142 expref: 10 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351343.677260:0:14284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cd9e27600) 00010000:00010000:1.0:1789351343.677264:0:14284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789351343.677268:0:14284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc5e00, rc 0) 00000100:00100000:1.0:1789351343.677437:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+10:14408:x1876270617047040:12345-192.168.201.52@tcp:101:lctl.0 Request processed in 2346us (2619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351343.677466:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:1.0:1789351343.691201:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351343.691663:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617047168 00000100:00100000:3.0:1789351343.691674:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617047168 00000100:00100000:3.0:1789351343.691737:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:3.0:1789351343.691765:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1704b0c7-86a0-46ac-bd08-d088e6e03fad+5:14409:x1876270617047168:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351343.691787:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351343.691808:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df80e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8149 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.691872:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8a00/0xa6ea017771df80eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.691887:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8a00/0xa6ea017771df80eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.691897:0:14283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8a00/0xa6ea017771df80eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351343.691958:0:14283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789351343.691962:0:14283:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351343.691989:0:14283:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8a00/0xa6ea017771df80eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.692027:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df80e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8149 expref: 7 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.692062:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8a00/0xa6ea017771df80eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8149 expref: 6 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.692070:0:14283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cd9e27600) 00010000:00010000:3.0:1789351343.692073:0:14283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789351343.692076:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8a00, rc 0) 00000100:00100000:3.0:1789351343.692131:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1704b0c7-86a0-46ac-bd08-d088e6e03fad+6:14409:x1876270617047168:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 376us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351343.692136:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:0.0:1789351343.695078:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351343.695151:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617047296 00000100:00100000:3.0:1789351343.695165:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617047296 00000100:00100000:3.0:1789351343.695504:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:3.0:1789351343.695516:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1704b0c7-86a0-46ac-bd08-d088e6e03fad+6:14409:x1876270617047296:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351343.695550:0:14285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351343.695573:0:14285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df80f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8150 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.695636:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df80f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.695649:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df80f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.695662:0:14285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df80f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.695676:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df8100 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.695711:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df8100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.695721:0:14285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df8100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.695909:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df8107 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.695917:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df8107 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.695925:0:14285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df8107 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351343.695966:0:14285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1789351343.695969:0:14285:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351343.695990:0:14285:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df8107 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.696014:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df80f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.696021:0:14285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df80f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.696028:0:14285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df80f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.696033:0:14285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351343.696037:0:14285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df80f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.696050:0:14285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df80f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.696062:0:14285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cd9e27600) 00010000:00010000:3.0:1789351343.696065:0:14285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351343.696070:0:14285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df80f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.696076:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df80f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.696090:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df8100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.696095:0:14285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df8100 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.696101:0:14285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df8100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.696510:0:14285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351343.696514:0:14285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df8100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.696521:0:14285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df8100 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.696531:0:14285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d2ce0439400) 00010000:00010000:3.0:1789351343.696631:0:14285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351343.696635:0:14285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df8100 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.696653:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df8100 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.697137:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df80f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8150 expref: 8 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.697155:0:14285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df8107 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8150 expref: 7 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.697164:0:14285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2ce0439b00) 00010000:00010000:3.0:1789351343.697166:0:14285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789351343.697169:0:14285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9400, rc 0) 00000100:00100000:3.0:1789351343.697300:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1704b0c7-86a0-46ac-bd08-d088e6e03fad+7:14409:x1876270617047296:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1785us (2238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351343.697309:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 22 00000100:00100000:1.0:1789351343.700958:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351343.701125:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617047552 00000100:00100000:3.0:1789351343.701136:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617047552 00000100:00100000:3.0:1789351343.701255:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:3.0:1789351343.701267:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1704b0c7-86a0-46ac-bd08-d088e6e03fad+7:14409:x1876270617047552:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351343.701289:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351343.701311:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df810e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8157 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351343.701478:0:14283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789351343.701612:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df810e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8157 expref: 9 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.701647:0:14283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cd9e27600) 00010000:00010000:3.0:1789351343.701651:0:14283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789351343.701656:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df810e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8157 expref: 9 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.701670:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8400, rc 0) 00000100:00100000:3.0:1789351343.701747:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1704b0c7-86a0-46ac-bd08-d088e6e03fad+8:14409:x1876270617047552:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 477us (794us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1789351343.701755:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 23 00000100:00100000:1.0:1789351343.710425:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351343.710681:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617047808 00000100:00100000:2.0:1789351343.710692:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617047808 00000100:00100000:2.0:1789351343.710752:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 24 00000100:00100000:2.0:1789351343.710776:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1704b0c7-86a0-46ac-bd08-d088e6e03fad+8:14409:x1876270617047808:12345-192.168.201.52@tcp:36:lfs.0 00010000:00010000:2.0:1789351343.710840:0:14284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351343.710869:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9400/0xa6ea017771df8107 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8150 expref: 8 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.710890:0:14284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2ce0439b00) 00010000:00010000:2.0:1789351343.710902:0:14284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789351343.710949:0:14284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df811c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.710963:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df811c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.710974:0:14284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df811c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789351343.711222:0:14284:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8c3e6da reply state 00000000f2e71663 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df811c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351343.711232:0:14284:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789351343.711247:0:14284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1789351343.711341:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1704b0c7-86a0-46ac-bd08-d088e6e03fad+9:14409:x1876270617047808:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 578us (923us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789351343.711350:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 24 00010000:00010000:2.0:1789351343.713690:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df811c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.713708:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df811c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.713716:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df811c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.713722:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351343.713726:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df811c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.713734:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df811c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.713778:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2ce9e1a800) 00010000:00010000:2.0:1789351343.713782:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789351343.713787:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df811c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.713794:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1e00/0xa6ea017771df811c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351343.716030:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351343.717265:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617048064 00000100:00100000:2.0:1789351343.717276:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617048064 00000100:00100000:2.0:1789351343.717336:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:2.0:1789351343.717346:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf725aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1704b0c7-86a0-46ac-bd08-d088e6e03fad+8:14409:x1876270617048064:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1789351343.717665:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf725aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1704b0c7-86a0-46ac-bd08-d088e6e03fad+9:14409:x1876270617048064:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 319us (1644us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789351343.717674:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:1.0:1789351343.724154:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351343.724235:0:16150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617048320 00000100:00100000:2.0:1789351343.724245:0:16150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617048320 00000100:00100000:2.0:1789351343.724308:0:16150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:2.0:1789351343.724318:0:16150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1704b0c7-86a0-46ac-bd08-d088e6e03fad+9:14409:x1876270617048320:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351343.724343:0:16150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351343.724394:0:16150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df8123 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d815e expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724469:0:16150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df812a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724482:0:16150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df812a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724510:0:16150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df812a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724526:0:16150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df8131 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724534:0:16150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df8131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724540:0:16150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df8131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351343.724668:0:16150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789351343.724773:0:16150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df812a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724781:0:16150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df812a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724788:0:16150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df812a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724794:0:16150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc1a00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351343.724799:0:16150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df812a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724807:0:16150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df812a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724819:0:16150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cd9e27600) 00010000:00010000:2.0:1789351343.724822:0:16150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351343.724834:0:16150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df812a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724840:0:16150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc1a00/0xa6ea017771df812a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724856:0:16150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df8131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724862:0:16150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df8131 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724868:0:16150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df8131 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724886:0:16150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d00bc0e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351343.724890:0:16150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df8131 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724896:0:16150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df8131 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724905:0:16150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d2ce9e1ac00) 00010000:00010000:2.0:1789351343.724907:0:16150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351343.724910:0:16150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df8131 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724916:0:16150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0e00/0xa6ea017771df8131 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724954:0:16150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df8123 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d815e expref: 11 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724976:0:16150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cd9e27600) 00010000:00010000:2.0:1789351343.724978:0:16150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789351343.724982:0:16150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d00bc0200/0xa6ea017771df8123 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d815e expref: 11 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.724991:0:16150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d00bc0200, rc 0) 00000100:00100000:2.0:1789351343.726249:0:16150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1704b0c7-86a0-46ac-bd08-d088e6e03fad+10:14409:x1876270617048320:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1924us (2096us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789351343.726260:0:16150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 25 00000100:00100000:1.0:1789351343.729953:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351343.729988:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617048448 00000100:00100000:2.0:1789351343.730200:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617048448 00000100:00100000:2.0:1789351343.730282:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:2.0:1789351343.730291:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1704b0c7-86a0-46ac-bd08-d088e6e03fad+10:14409:x1876270617048448:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351343.730311:0:14284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351343.730330:0:14284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df813f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8165 expref: -99 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.730437:0:14284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78a00/0xa6ea017771df8146 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.730452:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78a00/0xa6ea017771df8146 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.730464:0:14284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78a00/0xa6ea017771df8146 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351343.730516:0:14284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789351343.730534:0:14284:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351343.730562:0:14284:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78a00/0xa6ea017771df8146 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.730585:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df813f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8165 expref: 12 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.730597:0:14284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78a00/0xa6ea017771df8146 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8165 expref: 11 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.730604:0:14284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:2.0:1789351343.730606:0:14284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789351343.730608:0:14284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cf0f78a00, rc 0) 00000100:00100000:2.0:1789351343.730654:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1704b0c7-86a0-46ac-bd08-d088e6e03fad+11:14409:x1876270617048448:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 365us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351343.730661:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 26 00000100:00100000:1.0:1789351343.735438:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351343.735469:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617048576 00000100:00100000:2.0:1789351343.735480:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617048576 00000100:00100000:2.0:1789351343.735527:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:2.0:1789351343.735537:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1704b0c7-86a0-46ac-bd08-d088e6e03fad+11:14409:x1876270617048576:12345-192.168.201.52@tcp:37:lfs.0 00000100:00100000:2.0:1789351343.741523:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1704b0c7-86a0-46ac-bd08-d088e6e03fad+11:14409:x1876270617048576:12345-192.168.201.52@tcp:37:lfs.0 Request processed in 5976us (6084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351343.741537:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:1.0:1789351343.744681:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351343.744776:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617048832 00000100:00100000:0.0:1789351343.744786:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617048832 00000100:00100000:0.0:1789351343.744840:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:0.0:1789351343.744851:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7751850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1704b0c7-86a0-46ac-bd08-d088e6e03fad+11:14409:x1876270617048832:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:0.0:1789351343.745087:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7751850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1704b0c7-86a0-46ac-bd08-d088e6e03fad+12:14409:x1876270617048832:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 238us (415us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789351343.745092:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:1.0:1789351343.776527:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351343.776610:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617048960 00000100:00100000:3.0:1789351343.776618:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617048960 00000100:00100000:3.0:1789351343.776671:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:3.0:1789351343.776681:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+10:14415:x1876270617048960:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789351343.776702:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351343.776724:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df814d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d816c expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.776811:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8154 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.776826:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.776836:0:14283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.776846:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df815b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.776861:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df815b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.776865:0:14283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df815b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.776959:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df8162 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.776965:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df8162 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.776969:0:14283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df8162 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351343.776992:0:14283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1789351343.776994:0:14283:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351343.777097:0:14283:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df8162 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777107:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777112:0:14283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8154 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777117:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8154 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777121:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351343.777124:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8154 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777133:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8154 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777142:0:14283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cd9e27600) 00010000:00010000:3.0:1789351343.777144:0:14283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351343.777148:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8154 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777152:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8154 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777161:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df815b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777164:0:14283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df815b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777168:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df815b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777171:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351343.777172:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df815b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777176:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df815b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777179:0:14283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d2ce0439400) 00010000:00010000:3.0:1789351343.777180:0:14283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351343.777182:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df815b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777191:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df815b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777213:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df814d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d816c expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777221:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9600/0xa6ea017771df8162 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d816c expref: 11 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.777225:0:14283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:3.0:1789351343.777227:0:14283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789351343.777228:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9600, rc 0) 00000100:00100000:3.0:1789351343.777311:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+11:14415:x1876270617048960:12345-192.168.201.52@tcp:101:bash.0 Request processed in 632us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351343.777315:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 27 00000100:00100000:1.0:1789351343.780804:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351343.780869:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617049216 00000100:00100000:3.0:1789351343.780878:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617049216 00000100:00100000:3.0:1789351343.780970:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 28 00000100:00100000:3.0:1789351343.780981:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffb67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+11:14415:x1876270617049216:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:3.0:1789351343.781003:0:14285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351343.781020:0:14285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df8169 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8173 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.781122:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df8170 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.781134:0:14285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78a00/0xa6ea017771df8146 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8165 expref: 11 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.781154:0:14285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df8170 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.781184:0:14285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78a00/0xa6ea017771df8146 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8165 expref: 11 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.781196:0:14285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78a00/0xa6ea017771df8146 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8165 expref: 11 pid: 14284 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351343.781209:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec46300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14285:1876270626460544:192.168.201.52@tcp:104: 00000100:00100000:3.0:1789351343.781287:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0cfde40 going to sleep for 11 seconds 00000100:00100000:1.0:1789351343.783721:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351343.783815:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617049344 00000100:00100000:2.0:1789351343.783823:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617049344 00010000:00010000:2.0:1789351343.783855:0:14268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78a00/0xa6ea017771df8146 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8165 expref: 12 pid: 14284 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351343.783890:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:2.0:1789351343.783911:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1704b0c7-86a0-46ac-bd08-d088e6e03fad+12:2347:x1876270617049344:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789351343.783925:0:14268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351343.783930:0:14268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78a00/0xa6ea017771df8146 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8165 expref: 12 pid: 14284 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.783940:0:14268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78a00/0xa6ea017771df8146 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8165 expref: 12 pid: 14284 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.783958:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:2.0:1789351343.783961:0:14268:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df8170 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.783967:0:14268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df8170 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.783972:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df8170 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.783983:0:14268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789351343.784031:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1704b0c7-86a0-46ac-bd08-d088e6e03fad+12:2347:x1876270617049344:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 121us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351343.784038:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00010000:00010000:3.0:1789351343.784205:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78a00/0xa6ea017771df8146 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8165 expref: 11 pid: 14284 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351343.784260:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec46300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14285:1876270626460544:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351343.784280:0:14285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df8170 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.784289:0:14285:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df8170 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.784295:0:14285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df8170 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.784314:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df8177 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.784323:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df8177 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.784338:0:14285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df8177 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.785009:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df817e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.785019:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df817e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.785027:0:14285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df817e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351343.785037:0:14285:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789351343.785064:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df8170 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.785071:0:14285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df8170 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.785077:0:14285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df8170 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.785083:0:14285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351343.785087:0:14285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df8170 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.785094:0:14285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df8170 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.785103:0:14285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:3.0:1789351343.785106:0:14285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789351343.785116:0:14285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df8170 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.785122:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df8170 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789351343.785132:0:14285:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007709cf97 reply state 000000008ac8b03b transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df8177 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351343.785140:0:14285:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789351343.785170:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df8169 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8173 expref: 14 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.785182:0:14285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df817e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8173 expref: 13 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.785188:0:14285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:3.0:1789351343.785190:0:14285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789351343.785192:0:14285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8600, rc 0) 00000100:00100000:3.0:1789351343.785341:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffb67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+14:14415:x1876270617049216:12345-192.168.201.52@tcp:101:bash.0 Request processed in 4362us (4545us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789351343.785349:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 28 00010000:00010000:2.0:1789351343.788298:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df8177 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.788315:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df8177 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.788322:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df8177 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.788346:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351343.788351:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df8177 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.788543:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df8177 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.788560:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d2ce0439400) 00010000:00010000:2.0:1789351343.788563:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351343.788567:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df8177 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.788573:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8400/0xa6ea017771df8177 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351343.796271:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351343.796542:0:16150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617049472 00000100:00100000:2.0:1789351343.796552:0:16150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617049472 00000100:00100000:2.0:1789351343.796653:0:16150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:2.0:1789351343.796665:0:16150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+13:14415:x1876270617049472:12345-192.168.201.52@tcp:101:bash.0 00010000:00010000:2.0:1789351343.796690:0:16150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351343.796711:0:16150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df818c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d817a expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.796812:0:16150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8193 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.796827:0:16150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8193 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.796854:0:16150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8193 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351343.796911:0:16150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789351343.796916:0:16150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351343.796938:0:16150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8193 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.796949:0:16150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8193 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.796973:0:16150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df818c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d817a expref: 15 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.796992:0:16150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8193 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d817a expref: 14 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.797014:0:16150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:2.0:1789351343.797017:0:16150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789351343.797021:0:16150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cf0f79600, rc 0) 00000100:00100000:2.0:1789351343.797084:0:16150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+14:14415:x1876270617049472:12345-192.168.201.52@tcp:101:bash.0 Request processed in 422us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351343.797092:0:16150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 29 00000100:00100000:1.0:1789351343.800323:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351343.800411:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617049728 00000100:00100000:2.0:1789351343.800419:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617049728 00000100:00100000:2.0:1789351343.800454:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:2.0:1789351343.800461:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+14:14415:x1876270617049728:12345-192.168.201.52@tcp:35:bash.0 00000100:00100000:2.0:1789351343.800797:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+15:14415:x1876270617049728:12345-192.168.201.52@tcp:35:bash.0 Request processed in 335us (480us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789351343.800818:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:1.0:1789351343.866071:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351343.866158:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617049984 00000100:00100000:2.0:1789351343.866168:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617049984 00000100:00100000:2.0:1789351343.866236:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:2.0:1789351343.866247:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceee17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+15:14425:x1876270617049984:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1789351343.866270:0:14284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351343.866290:0:14284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df819a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8181 expref: -99 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351343.866429:0:14284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789351343.866536:0:14284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df819a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8181 expref: 17 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.866550:0:14284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2cd9e27600) 00010000:00010000:2.0:1789351343.866553:0:14284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789351343.866558:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df819a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8181 expref: 17 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.866573:0:14284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cf0f79e00, rc 0) 00000100:00100000:2.0:1789351343.866631:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceee17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+16:14425:x1876270617049984:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 386us (571us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789351343.866637:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 30 00000100:00100000:1.0:1789351343.869726:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351343.870841:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617050240 00000100:00100000:2.0:1789351343.870853:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617050240 00000100:00100000:2.0:1789351343.870922:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:2.0:1789351343.870933:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+16:14425:x1876270617050240:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1789351343.871188:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+17:14425:x1876270617050240:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 256us (1470us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789351343.871196:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:1.0:1789351343.905179:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351343.905350:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617050496 00000100:00100000:3.0:1789351343.905392:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617050496 00000100:00100000:3.0:1789351343.905456:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:3.0:1789351343.905467:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+17:14428:x1876270617050496:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:3.0:1789351343.905493:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351343.905517:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df81a8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8188 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.905647:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df81af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.905661:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df81af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.905673:0:14283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df81af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351343.905685:0:14283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789351343.905823:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df81a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8188 expref: 20 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.905840:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df81af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8188 expref: 19 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351343.905848:0:14283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:3.0:1789351343.905851:0:14283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789351343.905854:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9200, rc 0) 00000100:00100000:3.0:1789351343.905978:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+19:14428:x1876270617050496:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 511us (807us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789351343.905985:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 31 00000100:00100000:1.0:1789351343.908229:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351343.908272:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351343.908399:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617050752 00000100:00100000:2.0:1789351343.908407:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617050752 00000100:00100000:2.0:1789351343.908464:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:2.0:1789351343.908474:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+19:14428:x1876270617050752:12345-192.168.201.52@tcp:54:lfs.0 00010000:00010000:2.0:1789351343.908531:0:14284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.908547:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.908558:0:14284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.908582:0:14284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.908588:0:14284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81bd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.908595:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.908601:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f79e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351343.908605:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.908611:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.908630:0:14284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:2.0:1789351343.908633:0:14284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789351343.908637:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81bd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351343.908642:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81bd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351343.908714:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+19:14428:x1876270617050752:12345-192.168.201.52@tcp:54:lfs.0 Request processed in 241us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351343.908722:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 32 00000100:00100000:0.0:1789351343.908833:0:14270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617050624 00000100:00100000:0.0:1789351343.908838:0:14270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617050624 00000100:00100000:0.0:1789351343.908877:0:14270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:0.0:1789351343.908885:0:14270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+19:2350:x1876270617050624:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351343.908895:0:14270:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351343.908910:0:14270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9200/0xa6ea017771df81af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8188 expref: 19 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351343.908933:0:14270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:0.0:1789351343.908937:0:14270:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351343.908970:0:14270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+18:2350:x1876270617050624:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 86us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351343.908976:0:14270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:1.0:1789351343.912029:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351343.912093:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617051008 00000100:00100000:2.0:1789351343.912102:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617051008 00000100:00100000:2.0:1789351343.912156:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:2.0:1789351343.912167:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+18:14428:x1876270617051008:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:2.0:1789351343.912487:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+19:14428:x1876270617051008:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 321us (466us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789351343.912495:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1789351344.131463:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351344.131539:0:16150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617051264 00000100:00100000:2.0:1789351344.131548:0:16150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617051264 00000100:00100000:2.0:1789351344.131661:0:16150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:2.0:1789351344.131673:0:16150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+19:14459:x1876270617051264:12345-192.168.201.52@tcp:101:cat.0 00010000:00010000:2.0:1789351344.131696:0:16150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351344.131716:0:16150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81c4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d818f expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.131847:0:16150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81cb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.131867:0:16150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.131878:0:16150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351344.131890:0:16150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789351344.132032:0:16150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d818f expref: 22 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.132051:0:16150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d818f expref: 21 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.132059:0:16150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:2.0:1789351344.132062:0:16150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789351344.132065:0:16150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cf0f78600, rc 0) 00000100:00100000:2.0:1789351344.132130:0:16150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+21:14459:x1876270617051264:12345-192.168.201.52@tcp:101:cat.0 Request processed in 459us (676us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789351344.132138:0:16150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 33 00000100:00100000:1.0:1789351344.134607:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351344.135568:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617051520 00000100:00100000:3.0:1789351344.135577:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617051520 00000100:00100000:3.0:1789351344.135624:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:3.0:1789351344.135632:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+21:14459:x1876270617051520:12345-192.168.201.52@tcp:35:cat.0 00000100:00100000:1.0:1789351344.135854:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351344.135906:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617051648 00000100:00100000:2.0:1789351344.135911:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617051648 00000100:00100000:2.0:1789351344.135959:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:2.0:1789351344.135969:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+23:2349:x1876270617051648:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789351344.135980:0:14269:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789351344.136002:0:14269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81cb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d818f expref: 23 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.136029:0:14269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:2.0:1789351344.136035:0:14269:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351344.136208:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+22:14459:x1876270617051520:12345-192.168.201.52@tcp:35:cat.0 Request processed in 575us (1607us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789351344.136216:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 8 00000100:00100000:2.0:1789351344.137213:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+21:2349:x1876270617051648:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 1243us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351344.137222:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:1.0:1789351344.178455:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351344.178536:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617051904 00000100:00100000:2.0:1789351344.178544:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617051904 00000100:00100000:2.0:1789351344.178588:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:2.0:1789351344.178595:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+21:14465:x1876270617051904:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:2.0:1789351344.178614:0:14284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351344.178630:0:14284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81d9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d8196 expref: -99 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.178725:0:14284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81e0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.178739:0:14284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df817e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8173 expref: 22 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.178747:0:14284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8193 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d817a expref: 22 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.178768:0:14284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81e0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.178803:0:14284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8193 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d817a expref: 22 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.178835:0:14284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8193 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d817a expref: 22 pid: 16150 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351344.178848:0:14284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14284:1876270626460672:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351344.179134:0:14284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df817e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8173 expref: 22 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.179144:0:14284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df817e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8173 expref: 22 pid: 14285 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351344.179154:0:14284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc31a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14284:1876270626460800:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351344.179180:0:14284:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd819da80 going to sleep for 11 seconds 00000100:00100000:1.0:1789351344.182270:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351344.182297:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351344.182405:0:14270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617052032 00000100:00100000:0.0:1789351344.182414:0:14270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617052032 00010000:00010000:0.0:1789351344.182444:0:14270:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8193 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d817a expref: 23 pid: 16150 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351344.182473:0:14270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617052160 00000100:00100000:0.0:1789351344.182475:0:14270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617052160 00010000:00010000:0.0:1789351344.182484:0:14270:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df817e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8173 expref: 24 pid: 14285 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351344.182493:0:14270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:0.0:1789351344.182499:0:14270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf6952c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+24:2348:x1876270617052032:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351344.182509:0:14270:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351344.182513:0:14270:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8193 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d817a expref: 24 pid: 16150 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.182523:0:14270:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8193 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d817a expref: 24 pid: 16150 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.182541:0:14270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:0.0:1789351344.182544:0:14270:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81e0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.182561:0:14270:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81e0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.182566:0:14270:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351344.182604:0:14270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf6952c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+24:2348:x1876270617052032:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 106us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351344.182609:0:14270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:0.0:1789351344.182650:0:14270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 12 00000100:00100000:0.0:1789351344.182654:0:14270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+23:2348:x1876270617052160:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351344.182658:0:14270:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351344.182661:0:14270:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df817e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8173 expref: 23 pid: 14285 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.182667:0:14270:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df817e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8173 expref: 23 pid: 14285 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.182675:0:14270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:0.0:1789351344.182677:0:14270:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81e0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.182682:0:14270:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81e0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.182700:0:14270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81e0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.182720:0:14270:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351344.182738:0:14270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+23:2348:x1876270617052160:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 83us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351344.182749:0:14270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 12 00010000:00010000:2.0:1789351344.183059:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8193 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d817a expref: 22 pid: 16150 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351344.183077:0:14284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14284:1876270626460672:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351344.183419:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8600/0xa6ea017771df817e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8173 expref: 21 pid: 14285 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351344.183432:0:14284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc31a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14284:1876270626460800:192.168.201.52@tcp:104: 00010000:00010000:2.0:1789351344.183452:0:14284:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81e0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.183460:0:14284:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81e0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.183473:0:14284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81e0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351344.183492:0:14284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789351344.183646:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81d9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8196 expref: 22 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.183661:0:14284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79e00/0xa6ea017771df81e0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d8196 expref: 21 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.183669:0:14284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:2.0:1789351344.183672:0:14284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789351344.183674:0:14284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cf0f79e00, rc 0) 00000100:00100000:2.0:1789351344.184072:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+21:14465:x1876270617051904:12345-192.168.201.52@tcp:101:dd.0 Request processed in 5475us (5623us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789351344.184088:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 34 00000100:00100000:1.0:1789351344.186301:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351344.186460:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617052416 00000100:00100000:3.0:1789351344.186469:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617052416 00000100:00100000:3.0:1789351344.186545:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 35 00000100:00100000:3.0:1789351344.186556:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+21:14465:x1876270617052416:12345-192.168.201.52@tcp:36:dd.0 00010000:00010000:3.0:1789351344.186828:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df81ee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.186845:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df81ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.186856:0:14283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df81ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789351344.187936:0:14283:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789351344.187992:0:14283:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9026e7f reply state 00000000377630d4 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df81ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351344.188001:0:14283:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789351344.188092:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+24:14465:x1876270617052416:12345-192.168.201.52@tcp:36:dd.0 Request processed in 1537us (1797us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789351344.188098:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 35 00000020:00080000:3.0:1789351344.188102:0:14283:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789351344.194263:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:2.0:1789351344.194371:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df81ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.194384:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df81ee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.194392:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df81ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351344.194398:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617052544 00010000:00010000:2.0:1789351344.194399:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351344.194406:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df81ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351344.194410:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617052544 00010000:00010000:2.0:1789351344.194434:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df81ee lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.194451:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:2.0:1789351344.194454:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351344.194459:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df81ee lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.194476:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8200/0xa6ea017771df81ee lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351344.194530:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:1.0:1789351344.194540:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+23:14465:x1876270617052544:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:1.0:1789351344.194564:0:14285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351344.194582:0:14285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df81f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d819d expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.194642:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df81f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d819d expref: 24 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.194656:0:14285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df81f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d819d expref: 24 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.194676:0:14285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:1.0:1789351344.194679:0:14285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789351344.194682:0:14285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4c00, rc 0) 00000100:00100000:1.0:1789351344.194747:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+24:14465:x1876270617052544:12345-192.168.201.52@tcp:101:dd.0 Request processed in 208us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351344.194765:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 36 00000100:00100000:1.0:1789351344.210677:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351344.210836:0:14270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617052800 00000100:00100000:0.0:1789351344.210846:0:14270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617052800 00000100:00100000:0.0:1789351344.210946:0:14270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:0.0:1789351344.210958:0:14270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+24:14465:x1876270617052800:12345-192.168.201.52@tcp:103:dd.0 00010000:00010000:0.0:1789351344.210974:0:14270:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351344.210998:0:14270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df81f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d819d expref: 24 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.211018:0:14270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:0.0:1789351344.211023:0:14270:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789351344.211075:0:14270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+23:14465:x1876270617052800:12345-192.168.201.52@tcp:103:dd.0 Request processed in 120us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351344.211084:0:14270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:0.0:1789351344.212854:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351344.214431:0:16150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617052928 00000100:00100000:2.0:1789351344.214444:0:16150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617052928 00000100:00100000:2.0:1789351344.214503:0:16150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:2.0:1789351344.214514:0:16150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+23:14465:x1876270617052928:12345-192.168.201.52@tcp:58:dd.0 00010000:00010000:2.0:1789351344.214617:0:16150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81fc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.214632:0:16150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81fc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.214643:0:16150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81fc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789351344.215139:0:16150:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789351344.215352:0:16150:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789351344.215466:0:16150:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789351344.215559:0:16150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+23:14465:x1876270617052928:12345-192.168.201.52@tcp:58:dd.0 Request processed in 1046us (2707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351344.215567:0:16150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 37 00000100:00100000:3.0:1789351344.218214:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351344.218537:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617053056 00000100:00100000:2.0:1789351344.218546:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617053056 00000100:00100000:2.0:1789351344.218600:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 38 00000100:00100000:2.0:1789351344.218610:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+23:14465:x1876270617053056:12345-192.168.201.52@tcp:101:dd.0 00010000:00010000:2.0:1789351344.218627:0:14284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789351344.218646:0:14284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8203 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d81a4 expref: -99 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.218693:0:14284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81fc lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.218703:0:14284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8203 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81a4 expref: 24 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.218720:0:14284:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81fc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.218732:0:14284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8203 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81a4 expref: 24 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.218744:0:14284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:2.0:1789351344.218747:0:14284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789351344.218762:0:14284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8203 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81a4 expref: 24 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.218770:0:14284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2cf0f79600, rc 0) 00000100:00100000:2.0:1789351344.218820:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+24:14465:x1876270617053056:12345-192.168.201.52@tcp:101:dd.0 Request processed in 210us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351344.218827:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 38 00010000:00010000:0.0:1789351344.355656:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789351344.609668:0:14315:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789351344.609678:0:14315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789351344.609714:0:14315:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789351344.609722:0:14315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789351344.609861:0:14315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc77800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14315:1876270626460928:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789351344.609974:0:14315:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6112840 going to sleep for 11 seconds 00000100:00100000:3.0:1789351344.613682:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351344.613715:0:14315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc77800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14315:1876270626460928:192.168.201.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789351344.614146:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617053184 00000100:00100000:1.0:1789351344.614154:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617053184 00000100:00100000:1.0:1789351344.614292:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:1.0:1789351344.614304:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:53889ff8-25a9-4f06-adfc-5fffc69706fc+24:14467:x1876270617053184:12345-192.168.201.52@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789351344.614415:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:53889ff8-25a9-4f06-adfc-5fffc69706fc+24:14467:x1876270617053184:12345-192.168.201.52@tcp:900:lhsmtool_posix.0 Request processed in 113us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351344.614428:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:1.0:1789351344.621603:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351344.621779:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617053312 00000100:00100000:3.0:1789351344.621795:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617053312 00000100:00100000:3.0:1789351344.621860:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:3.0:1789351344.621870:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+24:14467:x1876270617053312:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789351344.621906:0:14283:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789351344.622018:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+24:14467:x1876270617053312:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 148us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351344.622025:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 39 00000100:00100000:0.0:1789351344.625554:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351344.625655:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617053440 00000100:00100000:2.0:1789351344.625670:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617053440 00000100:00100000:2.0:1789351344.625806:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:2.0:1789351344.625818:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+24:14467:x1876270617053440:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789351344.625905:0:14284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78e00/0xa6ea017771df820a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.625922:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78e00/0xa6ea017771df820a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.625936:0:14284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78e00/0xa6ea017771df820a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626105:0:14284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78200/0xa6ea017771df8211 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626122:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78200/0xa6ea017771df8211 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626135:0:14284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78200/0xa6ea017771df8211 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626189:0:14284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78400/0xa6ea017771df8218 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626200:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78400/0xa6ea017771df8218 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626208:0:14284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78400/0xa6ea017771df8218 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789351344.626264:0:14284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789351344.626285:0:14284:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789351344.626304:0:14284:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78400/0xa6ea017771df8218 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626319:0:14284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78e00/0xa6ea017771df820a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626327:0:14284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78e00/0xa6ea017771df820a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626335:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78e00/0xa6ea017771df820a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626342:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f78e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351344.626347:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78e00/0xa6ea017771df820a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626389:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78e00/0xa6ea017771df820a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626405:0:14284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2cd9e27e00) 00010000:00010000:2.0:1789351344.626408:0:14284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351344.626413:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78e00/0xa6ea017771df820a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626419:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78e00/0xa6ea017771df820a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626436:0:14284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78200/0xa6ea017771df8211 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626442:0:14284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78200/0xa6ea017771df8211 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626458:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78200/0xa6ea017771df8211 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626464:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f78200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351344.626466:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78200/0xa6ea017771df8211 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626473:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78200/0xa6ea017771df8211 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626481:0:14284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8d2ce9e1ac00) 00010000:00010000:2.0:1789351344.626484:0:14284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351344.626487:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78200/0xa6ea017771df8211 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626493:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78200/0xa6ea017771df8211 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626510:0:14284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78400/0xa6ea017771df8218 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626517:0:14284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78400/0xa6ea017771df8218 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626523:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78400/0xa6ea017771df8218 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626529:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f78400 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351344.626532:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78400/0xa6ea017771df8218 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626547:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78400/0xa6ea017771df8218 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626555:0:14284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:2.0:1789351344.626558:0:14284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351344.626561:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78400/0xa6ea017771df8218 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.626567:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78400/0xa6ea017771df8218 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351344.626676:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+24:14467:x1876270617053440:12345-192.168.201.52@tcp:34:lhsmtool_posix.0 Request processed in 858us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351344.626687:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 40 00000100:00100000:1.0:1789351344.635521:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351344.635846:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617053696 00000100:00100000:3.0:1789351344.635864:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617053696 00000100:00100000:3.0:1789351344.635951:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:3.0:1789351344.635963:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+24:14467:x1876270617053696:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351344.636000:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351344.636027:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df821f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d81ab expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.636233:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8226 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.636253:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8226 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.636268:0:14283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8226 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351344.636285:0:14283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789351344.636827:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8226 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.636837:0:14283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8226 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.636869:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8226 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.636875:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd9800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:3.0:1789351344.636880:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8226 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.636890:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8226 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.636906:0:14283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:3.0:1789351344.636909:0:14283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789351344.636915:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8226 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.636923:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df8226 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.636997:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df821f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81ab expref: 26 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.637010:0:14283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2cd9e27e00) 00010000:00010000:3.0:1789351344.637012:0:14283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789351344.637017:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df821f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81ab expref: 26 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.637027:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8c00, rc 0) 00000100:00100000:3.0:1789351344.637237:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+25:14467:x1876270617053696:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 1275us (3467us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1789351344.637256:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 41 00000100:00100000:3.0:1789351344.640613:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351344.640721:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617053824 00000100:00100000:1.0:1789351344.640734:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617053824 00000100:00100000:1.0:1789351344.640843:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:1.0:1789351344.640857:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+25:14467:x1876270617053824:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789351344.640905:0:14285:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789351344.641073:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+25:14467:x1876270617053824:12345-192.168.201.52@tcp:53:lhsmtool_posix.0 Request processed in 218us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351344.641082:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 42 00000100:00100000:2.0:1789351344.644650:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351344.651856:0:16150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617054080 00000100:00100000:1.0:1789351344.651881:0:16150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617054080 00000100:00100000:1.0:1789351344.651985:0:16150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:1.0:1789351344.651998:0:16150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+25:14467:x1876270617054080:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789351344.652027:0:16150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351344.652056:0:16150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df8234 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d81b2 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789351344.654341:0:16150:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1789351344.654383:0:16150:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1789351344.654871:0:16150:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1789351344.655777:0:16150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df823b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.655801:0:16150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df823b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.655816:0:16150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df823b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.655919:0:16150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df8234 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81b2 expref: 28 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.655941:0:16150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df823b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81b2 expref: 27 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.655951:0:16150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2cc3d1c800) 00010000:00010000:1.0:1789351344.655954:0:16150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789351344.655958:0:16150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4e00, rc 0) 00000100:00100000:1.0:1789351344.656048:0:16150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+27:14467:x1876270617054080:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 4052us (11427us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1789351344.656059:0:16150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 43 00000100:00100000:1.0:1789351344.658393:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351344.658474:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617054336 00000100:00100000:0.0:1789351344.658500:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617054336 00000100:00100000:0.0:1789351344.658564:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:0.0:1789351344.658573:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+27:14467:x1876270617054336:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789351344.658642:0:14285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351344.658678:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4e00/0xa6ea017771df823b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81b2 expref: 27 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.658712:0:14285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2cc3d1c800) 00010000:00010000:0.0:1789351344.658725:0:14285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789351344.658767:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045200/0xa6ea017771df8249 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.658782:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045200/0xa6ea017771df8249 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.658804:0:14285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045200/0xa6ea017771df8249 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.658824:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8250 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7af4a641 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.658830:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8250 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7af4a641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.658835:0:14285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8250 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7af4a641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.658944:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045200/0xa6ea017771df8249 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.658952:0:14285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045200/0xa6ea017771df8249 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.658965:0:14285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045200/0xa6ea017771df8249 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.658972:0:14285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02045200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351344.658977:0:14285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045200/0xa6ea017771df8249 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.658994:0:14285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045200/0xa6ea017771df8249 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.659003:0:14285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2ce9e1a900) 00010000:00010000:0.0:1789351344.659006:0:14285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351344.659010:0:14285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045200/0xa6ea017771df8249 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.659017:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045200/0xa6ea017771df8249 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.659029:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8250 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7af4a641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.659036:0:14285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8250 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7af4a641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.659042:0:14285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8250 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7af4a641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.659046:0:14285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02045c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351344.659060:0:14285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8250 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7af4a641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.659076:0:14285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8250 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7af4a641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.659085:0:14285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x7af4a641 (ffff8d2cd9e27000) 00010000:00010000:0.0:1789351344.659087:0:14285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351344.659090:0:14285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8250 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7af4a641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.659095:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8250 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7af4a641 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351344.659194:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+26:14467:x1876270617054336:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 620us (840us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789351344.659203:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 44 00000100:00100000:3.0:1789351344.662752:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351344.662918:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617054464 00000100:00100000:1.0:1789351344.662932:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617054464 00000100:00100000:1.0:1789351344.663013:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:1.0:1789351344.663026:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+26:14467:x1876270617054464:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789351344.663065:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351344.663098:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df8257 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d81b9 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.663147:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df825e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.663174:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df825e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.663210:0:14283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df825e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.663336:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df8257 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81b9 expref: 28 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.663397:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4800/0xa6ea017771df825e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81b9 expref: 27 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.663409:0:14283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2cc3d1ce00) 00010000:00010000:1.0:1789351344.663412:0:14283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789351344.663416:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4800, rc 0) 00000100:00100000:1.0:1789351344.663495:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+27:14467:x1876270617054464:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 471us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351344.663503:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 45 00000100:00100000:2.0:1789351344.666521:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351344.666830:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617054720 00000100:00100000:3.0:1789351344.666844:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617054720 00000100:00100000:3.0:1789351344.667196:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:3.0:1789351344.667212:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+27:14467:x1876270617054720:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789351344.667326:0:14284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df8265 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.667348:0:14284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df8265 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.667452:0:14284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df8265 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789351344.668264:0:14284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1789351344.668305:0:14284:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 289113946404ns, next at 290113915054ns, rc = 0 00000004:00010000:3.0:1789351344.668460:0:14284:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000283da1f1 reply state 00000000ce396f24 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df8265 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351344.668471:0:14284:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789351344.668609:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+29:14467:x1876270617054720:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 1399us (2098us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789351344.668618:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 46 00000100:00100000:3.0:1789351344.672652:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:2.0:1789351344.672738:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df8265 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.672761:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df8265 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.672770:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df8265 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.672778:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8e00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351344.672785:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df8265 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351344.672788:0:16150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617054848 00010000:00010000:2.0:1789351344.672796:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df8265 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351344.672808:0:16150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617054848 00010000:00010000:2.0:1789351344.672833:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2cc3d1ce00) 00010000:00010000:2.0:1789351344.672836:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789351344.672841:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df8265 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.672846:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8e00/0xa6ea017771df8265 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351344.672881:0:16150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:1.0:1789351344.672894:0:16150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+28:14467:x1876270617054848:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789351344.672926:0:16150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789351344.672948:0:16150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df826c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d81c0 expref: -99 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.673021:0:16150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df826c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81c0 expref: 29 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.673043:0:16150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df826c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81c0 expref: 29 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.673068:0:16150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2cc3d1ce00) 00010000:00010000:1.0:1789351344.673070:0:16150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789351344.673073:0:16150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecc4400, rc 0) 00000100:00100000:1.0:1789351344.673138:0:16150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+29:14467:x1876270617054848:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 247us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351344.673143:0:16150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 47 00000100:00100000:1.0:1789351344.675763:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351344.675883:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617054976 00000100:00100000:2.0:1789351344.675894:0:14965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617054976 00000100:00100000:2.0:1789351344.675968:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:2.0:1789351344.675978:0:14965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+5:2348:x1876270617054976:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789351344.676506:0:14965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:2348:x1876270617054976:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 528us (764us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789351344.676512:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:2.0:1789351344.678410:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351344.678488:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617055232 00000100:00100000:0.0:1789351344.678499:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617055232 00000100:00100000:0.0:1789351344.678578:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:0.0:1789351344.678586:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+29:14467:x1876270617055232:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789351344.678885:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+30:14467:x1876270617055232:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 299us (481us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1789351344.678894:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 9 00000100:00100000:1.0:1789351344.680838:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351344.683607:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617055488 00000100:00100000:0.0:1789351344.683624:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617055488 00000100:00100000:0.0:1789351344.683701:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:0.0:1789351344.683711:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+30:14467:x1876270617055488:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789351344.683889:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+30:14467:x1876270617055488:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 174us (3056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351344.683915:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 48 00000100:00100000:1.0:1789351344.686717:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351344.686794:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617055616 00000100:00100000:3.0:1789351344.686807:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617055616 00000100:00100000:3.0:1789351344.686897:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:3.0:1789351344.686909:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+30:14467:x1876270617055616:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351344.686934:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351344.686958:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df8273 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d81c7 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.687101:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df827a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.687126:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df827a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.687139:0:14283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df827a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789351344.687182:0:14283:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789351344.687203:0:14283:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df827a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.687235:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd8c00/0xa6ea017771df8273 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81c7 expref: 32 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.687256:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df827a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81c7 expref: 31 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.687267:0:14283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2cc3d1ce00) 00010000:00010000:3.0:1789351344.687318:0:14283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789351344.687323:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd9800, rc 0) 00000100:00100000:2.0:1789351344.687870:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+31:14467:x1876270617055616:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 953us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789351344.687881:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:2.0:1789351344.690670:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351344.690724:0:16151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617055744 00000100:00100000:3.0:1789351344.690737:0:16151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617055744 00000100:00100000:3.0:1789351344.690837:0:16151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:3.0:1789351344.690849:0:16151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+6:2347:x1876270617055744:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351344.690884:0:16151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351344.690911:0:16151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df8281 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d81ce expref: -99 pid: 16151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789351344.690947:0:16151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa755b0, blocks: 0x1 00010000:00010000:3.0:1789351344.690973:0:16151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=289s v=(0 0) 00010000:00010000:3.0:1789351344.690978:0:16151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351344.691139:0:16151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df8281 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81ce expref: 7 pid: 16151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.691164:0:16151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df8281 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81ce expref: 7 pid: 16151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.691180:0:16151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8000, rc 0) 00000100:00100000:3.0:1789351344.691253:0:16151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+7:2347:x1876270617055744:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 406us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351344.691261:0:16151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:1.0:1789351344.693582:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351344.693643:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617056000 00000100:00100000:3.0:1789351344.693655:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617056000 00000100:00100000:3.0:1789351344.693726:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:3.0:1789351344.693739:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+31:14467:x1876270617056000:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789351344.694065:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+31:14467:x1876270617056000:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 328us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351344.694073:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 50 00000100:00100000:1.0:1789351344.696290:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351344.696352:0:16150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617056128 00000100:00100000:2.0:1789351344.696457:0:16150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617056128 00000100:00100000:2.0:1789351344.696522:0:16150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:2.0:1789351344.696536:0:16150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+31:14467:x1876270617056128:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789351344.734656:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:2.0:1789351344.734683:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:2.0:1789351344.734757:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1789351344.736926:0:16150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+14:14467:x1876270617056128:12345-192.168.201.52@tcp:44:lhsmtool_posix.0 Request processed in 40381us (40633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351344.736943:0:16150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 51 00000100:00100000:0.0:1789351344.737156:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789351344.737174:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626461056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789351344.737243:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351344.737352:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626461056 00000100:00100000:1.0:1789351344.737382:0:14965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626461056 00000100:00100000:1.0:1789351344.737550:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789351344.737561:0:14965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1876270626461056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789351344.737767:0:14965:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789351344.737771:0:14965:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789351344.737773:0:14965:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789351344.737775:0:14965:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789351344 -> 1789351344 00002000:00010000:1.0:1789351344.737778:0:14965:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789351344.737821:0:14965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3288:x1876270626461056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 263us (578us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789351344.737829:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:0.0:1789351344.738021:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2cffc74000/2, rc 0, transno 8589934595 00000100:00100000:0.0:1789351344.738028:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876270626461056:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1789351344.739162:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789351344.740244:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351344.740586:0:14966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617056256 00000100:00100000:3.0:1789351344.740596:0:14966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617056256 00000100:00100000:3.0:1789351344.740730:0:14966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:3.0:1789351344.740777:0:14966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+7:2348:x1876270617056256:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789351344.741188:0:14966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+7:2348:x1876270617056256:12345-192.168.201.52@tcp:16:lhsmtool_posix.0 Request processed in 448us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351344.741198:0:14966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:1.0:1789351344.742791:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351344.742897:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617056512 00000100:00100000:0.0:1789351344.742908:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617056512 00000100:00100000:0.0:1789351344.743015:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:0.0:1789351344.743026:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf9d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+14:14467:x1876270617056512:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789351344.743093:0:14285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351344.743128:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecd9800/0xa6ea017771df827a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81c7 expref: 14 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.743153:0:14285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2cc3d1ce00) 00010000:00010000:0.0:1789351344.743160:0:14285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789351344.743215:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8288 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.743231:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8288 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.743240:0:14285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8288 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789351344.743574:0:14285:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2a3de01 reply state 0000000042e12a75 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8288 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351344.743585:0:14285:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789351344.743687:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf9d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+15:14467:x1876270617056512:12345-192.168.201.52@tcp:36:lhsmtool_posix.0 Request processed in 662us (901us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789351344.743696:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 52 00000100:00100000:1.0:1789351344.745710:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00010000:00010000:2.0:1789351344.745820:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8288 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.745834:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8288 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.745842:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8288 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.745854:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02045c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:2.0:1789351344.745863:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8288 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.745875:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8288 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.745898:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2cc3d1ce00) 00010000:00010000:2.0:1789351344.745901:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789351344.745907:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8288 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.745914:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02045c00/0xa6ea017771df8288 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14285 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351344.746145:0:14965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617056640 00000100:00100000:3.0:1789351344.746163:0:14965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617056640 00000100:00100000:3.0:1789351344.746225:0:14965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:3.0:1789351344.746237:0:14965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+7:14467:x1876270617056640:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789351344.746257:0:14965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789351344.746278:0:14965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df828f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb3a50041065d81d5 expref: -99 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.746313:0:14965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df8281 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81ce expref: 8 pid: 16151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.746324:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351344.746329:0:14965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351344.746337:0:14965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df828f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81d5 expref: 8 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.746672:0:14965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df8281 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81ce expref: 8 pid: 16151 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.746697:0:14965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df8281 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81ce expref: 8 pid: 16151 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351344.746710:0:14965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14965:1876270626461184:192.168.201.52@tcp:104: 00000100:00100000:2.0:1789351344.747059:0:14965:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0cfdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789351344.757964:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351344.758121:0:14965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14965:1876270626461184:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351344.758167:0:14965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df828f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81d5 expref: 8 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.758198:0:14965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ceecd8c00, rc 0) 00000100:00100000:1.0:1789351344.758285:0:14965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+8:14467:x1876270617056640:12345-192.168.201.52@tcp:101:lhsmtool_posix.0 Request processed in 12049us (12583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351344.758297:0:14965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 18 00000100:00100000:3.0:1789351344.758666:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617056768 00000100:00100000:3.0:1789351344.758676:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617056768 00010000:00010000:3.0:1789351344.758764:0:14268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df8281 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81ce expref: 8 pid: 16151 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351344.758795:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:3.0:1789351344.758805:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+8:2348:x1876270617056768:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351344.758973:0:14268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351344.759003:0:14268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df8281 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81ce expref: 8 pid: 16151 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.759018:0:14268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df8281 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81ce expref: 8 pid: 16151 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.759108:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081890290/0xa6ea017771df8281 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81ce expref: 8 pid: 16151 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.759126:0:14268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351344.759132:0:14268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351344.759163:0:14268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df828f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81d5 expref: 7 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.759175:0:14268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df828f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81d5 expref: 7 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.759219:0:14268:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df828f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81d5 expref: 7 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351344.759238:0:14268:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ceec45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14268:1876270626461312:192.168.201.52@tcp:105: 00000100:00100000:3.0:1789351344.759426:0:14268:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cd0cfd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789351344.764505:0:14268:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2ceec45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14268:1876270626461312:192.168.201.52@tcp:105: 00010000:00010000:3.0:1789351344.764538:0:14268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789351344.764609:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+7:2348:x1876270617056768:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 5805us (6659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351344.764622:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 13 00000100:00100000:0.0:1789351344.765593:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1789351344.765712:0:16151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617056896 00000100:00100000:2.0:1789351344.765722:0:16151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617056896 00000100:00100000:2.0:1789351344.765795:0:16151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:2.0:1789351344.765808:0:16151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+7:2347:x1876270617056896:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789351344.766094:0:16151:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789351344.766098:0:16151:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789351344 00002000:00010000:2.0:1789351344.766101:0:16151:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789351343 00002000:00010000:2.0:1789351344.766103:0:16151:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789351344 -> 1789351344 00002000:00010000:2.0:1789351344.766106:0:16151:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789351344.766168:0:16151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+8:2347:x1876270617056896:12345-192.168.201.52@tcp:2:lhsmtool_posix.0 Request processed in 363us (580us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789351344.766176:0:16151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 19 00000100:00100000:2.0:1789351344.771114:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351344.771860:0:14967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617057024 00000100:00100000:0.0:1789351344.771873:0:14967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617057024 00000100:00100000:0.0:1789351344.771951:0:14967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:0.0:1789351344.771963:0:14967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+8:2350:x1876270617057024:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789351344.772022:0:14967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df8296 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.772047:0:14967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df828f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81d5 expref: 8 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.772057:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351344.772062:0:14967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789351344.772068:0:14967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df8296 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.772114:0:14967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df828f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81d5 expref: 8 pid: 14965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.772155:0:14967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df828f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81d5 expref: 8 pid: 14965 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351344.772173:0:14967:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cffc74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:14967:1876270626461440:192.168.201.52@tcp:104: 00000100:00100000:0.0:1789351344.772291:0:14967:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc6112840 going to sleep for 11 seconds 00000100:00100000:3.0:1789351344.774141:0:14967:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cffc74a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:14967:1876270626461440:192.168.201.52@tcp:104: 00010000:00010000:3.0:1789351344.774175:0:14967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df8296 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351344.774559:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351344.774658:0:14270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617057152 00000100:00100000:0.0:1789351344.774666:0:14270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617057152 00010000:00010000:0.0:1789351344.774707:0:14270:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df828f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81d5 expref: 9 pid: 14965 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351344.774817:0:14270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:0.0:1789351344.774829:0:14270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+9:2348:x1876270617057152:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789351344.774847:0:14270:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789351344.774877:0:14270:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df828f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81d5 expref: 9 pid: 14965 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.774892:0:14270:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df828f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81d5 expref: 9 pid: 14965 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.774923:0:14270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df828f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81d5 expref: 9 pid: 14965 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.774943:0:14270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789351344.774961:0:14270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789351344.774968:0:14270:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df8296 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.774977:0:14270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df8296 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.775007:0:14270:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789351344.775165:0:14967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df8296 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.775176:0:14967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df8296 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.775216:0:14967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df8296 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.775225:0:14967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df8296 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.775234:0:14967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df8296 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.775242:0:14967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02045800 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351344.775248:0:14967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df8296 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.775258:0:14967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df8296 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.775272:0:14967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df8296 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.775280:0:14967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f99573c/0xa6ea017771df8296 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351344.775350:0:14270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+8:2348:x1876270617057152:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 522us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351344.775411:0:14270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 14 00000100:00100000:3.0:1789351344.775506:0:14967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53889ff8-25a9-4f06-adfc-5fffc69706fc+7:2350:x1876270617057024:12345-192.168.201.52@tcp:1:lhsmtool_posix.0 Request processed in 3546us (4406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351344.775525:0:14967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 20 00000100:00100000:0.0:1789351344.777538:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351344.777589:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617057408 00000100:00100000:1.0:1789351344.777599:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617057408 00000100:00100000:1.0:1789351344.777648:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:1.0:1789351344.777658:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+14:14467:x1876270617057408:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789351344.777762:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df829d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.777777:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df829d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.777786:0:14283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df829d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.778237:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df82a4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.778247:0:14283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df826c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81c0 expref: 15 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.778252:0:14283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df82a4 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.778287:0:14283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df826c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81c0 expref: 15 pid: 16150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.778299:0:14283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df826c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81c0 expref: 15 pid: 16150 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351344.778312:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc2c6fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14283:1876270626461568:192.168.201.52@tcp:104: 00000100:00100000:1.0:1789351344.778425:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2d27f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789351344.781398:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1789351344.781414:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc2c6fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14283:1876270626461568:192.168.201.52@tcp:104: 00010000:00010000:1.0:1789351344.781451:0:14283:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df82a4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351344.781453:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617057536 00000100:00100000:3.0:1789351344.781464:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617057536 00010000:00010000:3.0:1789351344.781505:0:14268:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df826c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81c0 expref: 16 pid: 16150 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351344.781539:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 15 00000100:00100000:3.0:1789351344.781549:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+16:2347:x1876270617057536:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789351344.781565:0:14268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789351344.781572:0:14268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df826c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81c0 expref: 16 pid: 16150 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.781584:0:14268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df826c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81c0 expref: 16 pid: 16150 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.781608:0:14268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4400/0xa6ea017771df826c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81c0 expref: 16 pid: 16150 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.781624:0:14268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2cc3d1ce00) 00010000:00010000:3.0:1789351344.781629:0:14268:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df82a4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.781638:0:14268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df82a4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.781645:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df82a4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351344.781683:0:14268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789351344.781709:0:14283:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df82a4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.781719:0:14283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df82a4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351344.781733:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+15:2347:x1876270617057536:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 183us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351344.781752:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 15 00000001:00080000:1.0:1789351344.781970:0:14283:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1789351344.782188:0:14283:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1789351344.782254:0:14283:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1789351344.782350:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc2c6fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14283:1876270626461696:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789351344.782481:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351344.782514:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cf757b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789351344.782552:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626461696 00000100:00100000:0.0:1789351344.782558:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626461696 00000100:00100000:0.0:1789351344.782602:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789351344.782611:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14283:x1876270626461696:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789351344.782699:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14283:x1876270626461696:12345-0@lo:1000:mdt00_000.0 Request processed in 90us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789351344.782704:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789351344.782848:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc2c6fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14283:1876270626461696:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789351344.783983:0:14283:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789351344.784054:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc2c6fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14283:1876270626461824:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789351344.784107:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351344.784139:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2d27f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789351344.784197:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626461824 00000100:00100000:0.0:1789351344.784203:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626461824 00000100:00100000:0.0:1789351344.784237:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789351344.784243:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc2c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14283:x1876270626461824:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789351344.784412:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc2c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14283:x1876270626461824:12345-0@lo:1000:mdt00_000.0 Request processed in 168us (304us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789351344.784419:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789351344.788653:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc2c6fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14283:1876270626461824:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789351344.788722:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df82a4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.788735:0:14283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df82a4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.788754:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df82a4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.788762:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5800 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351344.788767:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df82a4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.788777:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df82a4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.788798:0:14283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2cc3d1ce00) 00010000:00010000:1.0:1789351344.788802:0:14283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789351344.788807:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df82a4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.788814:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc5800/0xa6ea017771df82a4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.788860:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81fc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.788867:0:14283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81fc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.788897:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81fc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.788902:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f78600 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:1.0:1789351344.788905:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81fc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.788912:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81fc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.788920:0:14283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:1.0:1789351344.788924:0:14283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789351344.788931:0:14283:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8203 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81a4 expref: 18 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.788945:0:14283:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8203 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81a4 expref: 18 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.788955:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8203 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81a4 expref: 18 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.789006:0:14283:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f79600/0xa6ea017771df8203 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.52@tcp remote: 0xb3a50041065d81a4 expref: 18 pid: 14284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351344.789024:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc2c6e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14283:1876270626461952:192.168.201.52@tcp:105: 00000100:00100000:1.0:1789351344.789143:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d2cc2d27f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789351344.791583:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351344.791709:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617057664 00000100:00100000:3.0:1789351344.791720:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617057664 00000100:00100000:3.0:1789351344.791797:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:3.0:1789351344.791813:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cf7753c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+19:14465:x1876270617057664:12345-192.168.201.52@tcp:49:dd.0 00000100:00100000:3.0:1789351344.792074:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cf7753c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+19:14465:x1876270617057664:12345-192.168.201.52@tcp:49:dd.0 Request processed in 265us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789351344.792083:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 10 00000100:00100000:1.0:1789351344.792307:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc2c6e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14283:1876270626461952:192.168.201.52@tcp:105: 00010000:00010000:1.0:1789351344.792347:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81fc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.792374:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2cf0f78600/0xa6ea017771df81fc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792680:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82ab lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792703:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82ab lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792718:0:14283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82ab lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792729:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82ab lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792737:0:14283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82ab lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792759:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82ab lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792766:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02044200 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351344.792770:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82ab lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792779:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82ab lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792792:0:14283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:0.0:1789351344.792796:0:14283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789351344.792800:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82ab lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792807:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82ab lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792821:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df829d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792845:0:14283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df829d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792851:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df829d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792857:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4c00 already unused, calling callback (ffffffffc211b4f0) 00010000:00010000:0.0:1789351344.792860:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df829d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792867:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df829d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792876:0:14283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2ce0439100) 00010000:00010000:0.0:1789351344.792879:0:14283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789351344.792882:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df829d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.792887:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ceecc4c00/0xa6ea017771df829d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14283 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351344.793212:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+18:14467:x1876270617057408:12345-192.168.201.52@tcp:57:lhsmtool_posix.0 Request processed in 15554us (15678us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789351344.793224:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00000020:00080000:0.0:1789351344.793230:0:14283:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789351344.793678:0:14315:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789351344.793684:0:14315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789351344.793718:0:14315:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789351344.793724:0:14315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789351344.797059:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351344.797155:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617057920 00000100:00100000:0.0:1789351344.797185:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617057920 00000100:00100000:0.0:1789351344.797754:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 11 00000100:00100000:0.0:1789351344.797767:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+18:14467:x1876270617057920:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789351344.798656:0:14286:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789351344.798794:0:14286:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1789351344.798849:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82b2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.798871:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.798884:0:14286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.798894:0:14286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82b2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.798901:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82b2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.798908:0:14286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.798937:0:14286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789351344.799054:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53889ff8-25a9-4f06-adfc-5fffc69706fc+20:14467:x1876270617057920:12345-192.168.201.52@tcp:35:lhsmtool_posix.0 Request processed in 1287us (2008us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789351344.799062:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 11 00000020:00080000:0.0:1789351344.799070:0:14286:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789351344.799154:0:14272:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789351344.799163:0:14272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82b2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.799171:0:14272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02044200 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351344.799176:0:14272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82b2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.799185:0:14272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.799200:0:14272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2cc3d1ce00) 00010000:00010000:1.0:1789351344.799204:0:14272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789351344.799209:0:14272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82b2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.799216:0:14272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d02044200/0xa6ea017771df82b2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.799232:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351344.799234:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789351344.799236:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789351344.802029:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d2cc2c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626462080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789351344.802119:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789351344.802226:0:14968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270626462080 00000100:00100000:1.0:1789351344.802236:0:14968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270626462080 00000100:00100000:1.0:1789351344.802304:0:14968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789351344.802315:0:14968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cc31a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1876270626462080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789351344.802395:0:14968:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789351344.802466:0:14968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cc31a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1876270626462080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789351344.802474:0:14968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789351344.803103:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d2cc2c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876270626462080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789351344.873485:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351344.873542:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351344.873770:0:14970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617058176 00000100:00100000:2.0:1789351344.873778:0:14971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617058048 00000100:00100000:2.0:1789351344.873791:0:14971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617058048 00000100:00100000:0.0:1789351344.873793:0:14970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617058176 00000100:00100000:2.0:1789351344.873885:0:14971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:2.0:1789351344.873897:0:14971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+8:2348:x1876270617058176:12345-192.168.201.52@tcp:4:dd.0 00002000:00010000:2.0:1789351344.873968:0:14971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa755b0, atime: 0x6aa755af, ctime: 0x6aa755b0, blocks: 0x1 00010000:00010000:2.0:1789351344.873979:0:14971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eae0783/0xa6ea017771df82b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.873999:0:14971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=289s v=(0 0) 00010000:00010000:2.0:1789351344.874005:0:14971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351344.874012:0:14971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002eae0783/0xa6ea017771df82b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.874046:0:14971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002eae0783/0xa6ea017771df82b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351344.874156:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351344.874187:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351344.874296:0:14972:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789351344.874304:0:14972:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789351344.874642:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351344.874666:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351344.874904:0:14972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617058432 00000100:00100000:3.0:1789351344.874911:0:14972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617058432 00000100:00100000:3.0:1789351344.874945:0:14972:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789351344.874953:0:14972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617058304 00000100:00100000:3.0:1789351344.874956:0:14972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617058304 00000100:00100000:3.0:1789351344.874975:0:14972:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789351344.874982:0:14972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617058688 00000100:00100000:3.0:1789351344.874985:0:14972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617058688 00000100:00100000:3.0:1789351344.875380:0:14972:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789351344.875387:0:14972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617058560 00000100:00100000:3.0:1789351344.875390:0:14972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617058560 00000100:00100000:2.0:1789351344.875783:0:16502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:2.0:1789351344.875796:0:16502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ceec45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+13:2348:x1876270617058048:12345-192.168.201.52@tcp:4:dd.0 00010000:00010000:2.0:1789351344.875831:0:16502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028e3c424/0xa6ea017771df82c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.875849:0:16502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351344.875853:0:16502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351344.875859:0:16502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028e3c424/0xa6ea017771df82c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.875873:0:16502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028e3c424/0xa6ea017771df82c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351344.876245:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1789351344.876315:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1789351344.876338:0:14972:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789351344.876768:0:14970:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1789351344.876773:0:14972:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1789351344.876780:0:14970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617058944 00000100:00100000:1.0:1789351344.876787:0:14970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617058944 00000100:00100000:1.0:1789351344.876818:0:14970:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789351344.876824:0:14970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876270617058816 00000100:00100000:1.0:1789351344.876827:0:14970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876270617058816 00000100:00100000:1.0:1789351344.877734:0:16503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:1.0:1789351344.877758:0:16503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:53889ff8-25a9-4f06-adfc-5fffc69706fc+16:2348:x1876270617058432:12345-192.168.201.52@tcp:4:dd.0 00010000:00010000:1.0:1789351344.877792:0:16503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000809592a2/0xa6ea017771df82c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.877809:0:16503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789351344.877813:0:16503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789351344.877818:0:16503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000809592a2/0xa6ea017771df82c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.877832:0:16503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000809592a2/0xa6ea017771df82c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789351344.922644:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1789351344.922681:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:1.0:1789351344.926327:0:14971:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1789351344.926336:0:14971:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789351344 -> 1789351345 00002000:00010000:1.0:1789351344.926338:0:14971:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789351344 -> 1789351345 00002000:00010000:1.0:1789351344.926341:0:14971:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:1.0:1789351344.926377:0:14971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eae0783/0xa6ea017771df82b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.926398:0:14971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002eae0783/0xa6ea017771df82b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.926406:0:14971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002eae0783/0xa6ea017771df82b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.926411:0:14971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f79000 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351344.926415:0:14971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002eae0783/0xa6ea017771df82b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.926421:0:14971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002eae0783/0xa6ea017771df82b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.926443:0:14971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002eae0783/0xa6ea017771df82b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.926447:0:14971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002eae0783/0xa6ea017771df82b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351344.926553:0:14971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+18:2348:x1876270617058176:12345-192.168.201.52@tcp:4:dd.0 Request processed in 52654us (53077us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789351344.926561:0:14971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 0 00000100:00100000:1.0:1789351344.926605:0:14971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:1.0:1789351344.926828:0:14971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+17:2348:x1876270617058304:12345-192.168.201.52@tcp:4:dd.0 00010000:00010000:1.0:1789351344.926879:0:14971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b958b3b/0xa6ea017771df82ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.926900:0:14971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789351344.926906:0:14971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789351344.926913:0:14971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b958b3b/0xa6ea017771df82ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351344.926927:0:14971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b958b3b/0xa6ea017771df82ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.968441:0:16503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000809592a2/0xa6ea017771df82c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.968469:0:16503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000809592a2/0xa6ea017771df82c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.968481:0:16503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000809592a2/0xa6ea017771df82c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.968490:0:16503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc5800 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351344.968496:0:16503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000809592a2/0xa6ea017771df82c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.968506:0:16503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000809592a2/0xa6ea017771df82c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.968536:0:16503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000809592a2/0xa6ea017771df82c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.968545:0:16503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000809592a2/0xa6ea017771df82c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351344.968712:0:16503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:53889ff8-25a9-4f06-adfc-5fffc69706fc+19:2348:x1876270617058432:12345-192.168.201.52@tcp:4:dd.0 Request processed in 90951us (94547us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789351344.968723:0:16503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 2 00000100:00100000:0.0:1789351344.968877:0:16503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 4 00000100:00100000:0.0:1789351344.968893:0:16503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:53889ff8-25a9-4f06-adfc-5fffc69706fc+18:2348:x1876270617058688:12345-192.168.201.52@tcp:4:dd.0 00010000:00010000:0.0:1789351344.968937:0:16503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df82d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.968951:0:16503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351344.968957:0:16503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789351344.968964:0:16503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df82d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351344.968978:0:16503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df82d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789351344.969649:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00010000:00010000:2.0:1789351344.969892:0:16502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028e3c424/0xa6ea017771df82c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.969906:0:16502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028e3c424/0xa6ea017771df82c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.969915:0:16502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028e3c424/0xa6ea017771df82c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.969932:0:16502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f78000 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351344.969937:0:16502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028e3c424/0xa6ea017771df82c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.969946:0:16502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028e3c424/0xa6ea017771df82c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.969962:0:16502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028e3c424/0xa6ea017771df82c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.969970:0:16502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028e3c424/0xa6ea017771df82c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351344.970079:0:16502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ceec45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+14:2348:x1876270617058048:12345-192.168.201.52@tcp:4:dd.0 Request processed in 94282us (96532us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789351344.970088:0:16502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 1 00000100:00100000:2.0:1789351344.970115:0:16502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:2.0:1789351344.970125:0:16502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+13:2348:x1876270617058560:12345-192.168.201.52@tcp:4:dd.0 00010000:00010000:2.0:1789351344.970149:0:16502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b2f1f4/0xa6ea017771df82dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.970160:0:16502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351344.970163:0:16502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789351344.970170:0:16502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b2f1f4/0xa6ea017771df82dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351344.970194:0:16502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b2f1f4/0xa6ea017771df82dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789351345.010505:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:1.0:1789351345.011299:0:14971:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:1.0:1789351345.011310:0:14971:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1789351345.011337:0:14971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b958b3b/0xa6ea017771df82ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351345.011352:0:14971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b958b3b/0xa6ea017771df82ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351345.011384:0:14971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b958b3b/0xa6ea017771df82ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351345.011393:0:14971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351345.011399:0:14971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b958b3b/0xa6ea017771df82ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351345.011410:0:14971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b958b3b/0xa6ea017771df82ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351345.011461:0:14971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b958b3b/0xa6ea017771df82ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351345.011470:0:14971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b958b3b/0xa6ea017771df82ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351345.011600:0:14971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+15:2348:x1876270617058304:12345-192.168.201.52@tcp:4:dd.0 Request processed in 84977us (137402us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789351345.011613:0:14971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:1.0:1789351345.011658:0:14971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 6 00000100:00100000:1.0:1789351345.011694:0:14971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+14:2348:x1876270617058944:12345-192.168.201.52@tcp:4:dd.0 00010000:00010000:1.0:1789351345.011766:0:14971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ab3fa0f/0xa6ea017771df82e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351345.011782:0:14971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789351345.011787:0:14971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789351345.011795:0:14971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ab3fa0f/0xa6ea017771df82e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351345.011807:0:14971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ab3fa0f/0xa6ea017771df82e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789351345.012411:0:14279:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789351345.047699:0:16502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:3.0:1789351345.047713:0:16502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00000001:00080000:2.0:1789351345.047723:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00010000:00010000:3.0:1789351345.047732:0:16502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b2f1f4/0xa6ea017771df82dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789351345.047753:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00010000:00010000:3.0:1789351345.047763:0:16502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b2f1f4/0xa6ea017771df82dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351345.047774:0:16502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9b2f1f4/0xa6ea017771df82dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351345.047783:0:16502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2cf0f78e00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:3.0:1789351345.047789:0:16502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b2f1f4/0xa6ea017771df82dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351345.047801:0:16502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b2f1f4/0xa6ea017771df82dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351345.047832:0:16502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9b2f1f4/0xa6ea017771df82dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351345.047840:0:16502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b2f1f4/0xa6ea017771df82dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789351345.047975:0:16502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+12:2348:x1876270617058560:12345-192.168.201.52@tcp:4:dd.0 Request processed in 77843us (173300us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789351345.047987:0:16502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 5 00000100:00100000:3.0:1789351345.048875:0:16502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:3.0:1789351345.048895:0:16502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2cffc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+11:2348:x1876270617058816:12345-192.168.201.52@tcp:4:dd.0 00010000:00010000:3.0:1789351345.049121:0:16502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df82ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351345.049139:0:16502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351345.049144:0:16502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789351345.049153:0:16502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df82ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789351345.049169:0:16502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df82ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789351345.051467:0:16503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1789351345.051493:0:16503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df82d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351345.051517:0:16503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df82d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351345.051524:0:16503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df82d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351345.051529:0:16503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d02045c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:1.0:1789351345.051533:0:16503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df82d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351345.051540:0:16503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df82d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351345.051561:0:16503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df82d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789351345.051569:0:16503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bda4c07f/0xa6ea017771df82d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789351345.051914:0:16503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:53889ff8-25a9-4f06-adfc-5fffc69706fc+10:2348:x1876270617058688:12345-192.168.201.52@tcp:4:dd.0 Request processed in 83019us (177265us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1789351345.051925:0:16503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 4 00000001:00080000:0.0:1789351345.084974:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:2.0:1789351345.088676:0:14971:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1789351345.088702:0:14971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ab3fa0f/0xa6ea017771df82e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351345.088714:0:14971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ab3fa0f/0xa6ea017771df82e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351345.088722:0:14971:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ab3fa0f/0xa6ea017771df82e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351345.088727:0:14971:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecc4000 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:2.0:1789351345.088731:0:14971:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ab3fa0f/0xa6ea017771df82e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351345.088750:0:14971:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ab3fa0f/0xa6ea017771df82e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351345.088774:0:14971:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ab3fa0f/0xa6ea017771df82e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789351345.088789:0:14971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ab3fa0f/0xa6ea017771df82e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789351345.088905:0:14971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:53889ff8-25a9-4f06-adfc-5fffc69706fc+9:2348:x1876270617058944:12345-192.168.201.52@tcp:4:dd.0 Request processed in 77229us (212653us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789351345.088917:0:14971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 6 00000001:00080000:1.0:1789351345.109505:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:0.0:1789351345.109592:0:16502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df82ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351345.109612:0:16502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df82ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351345.109622:0:16502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df82ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351345.109655:0:16502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ceecd8c00 already unused, calling callback (ffffffffc1713fd0) 00010000:00010000:0.0:1789351345.109662:0:16502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df82ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351345.109672:0:16502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df82ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351345.109699:0:16502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df82ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789351345.109711:0:16502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b0d9b8e/0xa6ea017771df82ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789351345.109849:0:16502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2cffc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:53889ff8-25a9-4f06-adfc-5fffc69706fc+5:2348:x1876270617058816:12345-192.168.201.52@tcp:4:dd.0 Request processed in 60956us (233527us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789351345.110631:0:16502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00010000:00010000:0.0:1789351345.377571:0:14271:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789351346.018250:0:16540:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1789351346.401917:0:14272:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789351346.849672:0:14315:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789351346.849681:0:14315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789351346.849705:0:14315:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789351346.849722:0:14315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 Debug log: 27233 lines, 27233 kept, 0 dropped, 0 bad.